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ABSTRACT 

In April of 1980, the following goals were adopted 
for Operation Turnaround: (1) to raise significantly the achievement 
levels of students; (2) to develop positive staff perceptions with 
respect to the children they teach and the children's potential for 
growth; (3) to build at each school a cohesive, committed, and 
competent staff which would operate as a team; .(4) to significantly 
increase parent involvement and to develop an improved sense of 
community pride; and (5) to instill in each child a love for learning 
and a belief in self-determination and achievement of goals. In order 
to accomplish these goals, staff changes were initiated, 
instructional materials were upgraded, physical plant repairs and 
improvements were begun, and a major inservice training program was 
provided in three of the Dade County Public Schools: Holmes 
Elementary, Little River Elementary, and Orchard Villa Elementary. 
The evaluation found no evidence, from the available data, that 
Operation Turnaround has had an impact on student performance on 
either the State Student Assessment Tests or the Stanford Achievement 
Tests. The teacher questionnaire variables did not show 
program-related differences. Data on school crime indicate a sharp 
decline in the total number of reported violent incidents for the 
last two years at Operation Turnaround schools in relation to 
previous years and in relation to the last two years at the 
comparison schools. (BW) 
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THE SCHOOL BOARD OF OADE COUNTY, FLORIDA, ADHERES TO A 
POLICY OF NONDISCRIMINATION IN EDUCATIONAL PROGRA-MS/ 
ACTIVITIES AND ENPLOYMENT AfO STRIVES AFFIRMATIVELY TO 
PROVIDE EQUAL OPPORTUNITY FOR ALL AS REQUIRED BY: 



TITLE VI OF THE CIVIL RIGHTS ACT OF 1964 - PROHIB- 
ITS DISCRIMINATION ON THE BASIS OF RACE, CaOR, 
RELIGION, OR NATIONAL ORIGIN. 

TITLE VI i OF THE CIVIL RIGHTS ACT OF 1964, AS A,MEfC- 
ED - PROHIBITS DISCRIMINATION ^N^^LOYMENT ON THE 
BASIS OF RACE, COLOR RELIGION, OR r^jTlONAL ORIGIN. 

TITLE IX OF THE EDUCATION AMENDMENTS OF 1972 - PRO- 
HIBITS DISCRIMINATION ON THE BASIS OF SEX. 

AGE DISCRIMINATION ACT OF 1967, AS AMENDED - PROHIB- 
ITS DISCRIMINATION ON THE BASIS OF AGE BETWEEN 40 
AND 70. 

SECTION 504 OF THE REHABILITATION ACT OF 1973 - PRO- 
HIBITS DISCRIMINATION AGAINST THE HANDICAPPED. 



VETEF5ANS ARE PROVIDEL) RE-Ef-PLOYMENT RIGHTS IN ACCOWOANCi: 
WITH P.L. 93-503 (FEDERAL) AW FLORIDA STATE LAW, CHAP- 
TER 77-422, WHICH ALSO STIi^ULATES CATEGORICAL PRtFER- 
ENCES FOR ENPLOYMENT. 
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Executive Summary 



Operation Turnaround was developed as a result of program audits conducted 
by the Division of Elementary and Secondary Instruction (DESI) during the 
1979-80 school year. According to project documentation, the three schools 
chosen for audit were selected from among 53 deficient elementary schools 
in the county because the pattern of low performance was of long standing 
and seemingly resistant to amelioration. The schools selected for these 
audits and subsequently for Operation Turnaround were Holmes Elementary, 
Little River Elementary, and Orchard Villa .Elementary. 

After several planning sessions, beginning in April of 1980, the following 
goals were adopted for the Operation Turnaround schools: 

1. to raise significantly the achievement levels of students; 

2. to develop positive staff perceptions with respect to the chil- 
dren they teach and the children's potential for growth; 

3. to build at each school a cohesive, committed, and competent 
staff which would operate as a team; 

4. to significantly increase parent involvement and to develop an 
improved sense of community pride; 

5. to instill in each child a love for learning and a belief in 
self-determination and achievement of goals. 

In order to accomplish these goals, staff changes were initiated, instruc- 
tional materials were upgraded, physical plant repairs and improvements 
were begun, and a major inservice training program was provided. A coordi- 
nating council was established consisting of the principals, union stew- 
ards, appropriate area directors, other representatives from the United 
Teachers of Dade, and representatives from the Bureau of Education. This 
council was designated to act as a problem solving body for Operation Turn- 
around. In order to give teachers greater input to the decision making 
process at the school level, waivers of the teachers' contract in regard to 
provisions for faculty councils were obtained. This waiver provided for 
more faculty representation on steering committees at Operation Turnaround 
schools. • 

The evaluation examined several data sets from the Operation Turnaround 
schools and from another group of schools considered to be reasonably simi- 
lar. Variables included student achievement, teacher and student atti- 
tudes, teacher turnover, school crime, and program implementation informa- 
tion. 

State Student Assessment Tests 

In order to examine changes in State Student Assessment Test (SSAT) re- 
sults, data were gathered for Operation Turnaround schools, comparison 
schools and the district for the years 1977-78 through 1982-83. The pat- 
tern for these three sets of scores began with a relatively high point for 
the October, 1978 testing which was followed (in October 1979) by a minor 
decline in test scores over the district, no general decline in the compar- 
ison schools, and an extreme decline in the Operation Turnaround schools. 
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This was followed in the next year (October, 1980) by a recovery (to Octo- 
ber, 1978 levels) for the Operation Turnaround schools. Score patterns for 
both Operation Turnaround and comparison schools after this period show 
steady ..increases in test performance. 

It is not possible, at this point in time, to determine if the extreme 
decline in SSAT scores in 1979 for the Operation Turnaround schools was the 
beginning of a trend or if it was due to an isolated incidence. While it 
is possible that the decline was due to an unidentified problem which was 
alleviated by Operation Turnaround, it is also possible that the decline 
was an isolated incidence which corrected itself without the benefit of 
Operation Turnaround. Given the short time period between program onset 
and the testing (one month), the similarity of the subsequent trends for 
Operation Turnaround and comparison schools, on the SSAT, and the similari- 
ty of pre- and post-project trends on the Stanford, it can not be assumed 
that either the recovery in 1980 or the subsequent increase was a function 
of program influence. 

Stanford Achievement Tests 

A complex analysis was performed on the Stanford Achievement data from the 
Operation Turnaround schools and the comparison schools for three years 
previous to the onset of Operation Turnaround and one year following its 
beginni ng. 

Performance patterns for the three years prior to the initiation of Opera- 
tion Turnaround (1977-78 to 1979-80) reveal no substantial differences be- 
tween Operation Turnaround and comparison schooU, with levels of perform- 
ance for both sets of schools substantially below national norms and with 
an increase in this deficit from low to high grade levels. For the testing 
which occurred in February of 1981 (six months after the initiation of the 
progr'im) this pattern was essentially maintained. Stanfords administered 
in 1981-82 and 1982-83 were a different edition from those previously ad- 
ministered, and were not included in this analysis. 

Teacher Perceptions 

In order to assess staff perceptions of several factors in the schools 
which were felt to be critical to the success of the project, a teacher 
questionnaire was devised and distributed to all teachers in the Operation 
Turnaround and comparison schools. Eighty-five (of approximately 200 
teachers) completed and returned the questionnaires. 

Of the more than 50 variables abstracted from responses to the Teachers' 
Questionnaire, statistically significant response differences between Turn- 
around and comparison groups of schools were found in 8 variables. In a 
majority of cases these differences favored the comparison schools. This 
finding suggests that there was no consistent, programmatic irnpa=ct. 

Operation Turnaround teachers were asked to respond to questions regarding 
the implementation of Operation Turnaround components. Teachers appeared 
well informed about the initial plans for Operation Turnaround but gave a 
mean rating of 2.95 on a five point scale for the implementation of those 
plans after three years. The disparity between expected improvements and 
actual improvements may well have had a negative effect on teacher percep- 
tions regarding program implementation. 
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Teacher Stability 



The number of teachers not returning to Operation Turnaround schools and 
comparison schools each year from 1978-79 through 1981-82 was investigated. 
Except for 1980-81 which was the' first year of the program, a greater per- 
centage of Operation Turnaround teachers left their schools than comparison 
school teachers. Overall, 28 percent of the Operation Turnaround schools' 
teachers left from 1978-79 through 19^1-82, while 23 percent of the compar- 
ison schools' teachers left. 

Parent and Community Involvement 

In order to determine if there was parental awareness of Operation Turn- 
around, a small sample of parents whose children had been attending an 
Operation Turnaround school for several years were interviewed by tele- 
phone. The size of the sample (21) and the difficulty encountered in es- 
tablishing telephone contact with many of the parents necessitate caution 
in interpreting the results of these interviews. It is important to note, 
however, that dnly two of the parents contacted had heard of Operation 
Turnaround and none of them really knew what it was. There was, however, a 
positive regard for the schools in general. 

Violent incident rates were examined as a possible indicator of community 
involvement. Operation Turnaround schools had a sharp decline in total re- 
■ ported violent incidents in 1981-82 and 1932-83, relative to the comparison 
schools. Thus, there was apparently some program impact on community in- 
volvement at these schools. 

Student Affective Measures 

Three scales were used to examine students' attitudes: the School Morale 
Attitude Survey, the Intellectual Achievement Responsibility Scale, and a 
"Who Helps You" scale. On these three measures of student affect, very 
little difference between Operation Turnaround schools and comparison 
schools was found. In effect, there was no consistent indication of impact 
on student affect that could be attributed to Operation Turnaround. 

Student Attendance 

Attendance at all six schools appeared to be consistently high over the 
years. There did not appear to be differences in attendance either among 
individual schools or between comparison and Turnaround schools. 



To summarize , there is no evidence, from the available data, that Operation 
Turnaround has had an impact on student performance on either the State 
Student Assessment tests or the Stanford Achievement tests. The teacher 
questionnaire variables did not show program related differences. Data on 
school crime indicate a sharp decline in the total of reported violent in- 
cidents for the last two years at Operation Turnaround schools in relation 
to previous years and in relation to the last two years at the comparison 
schcol s. 



Literature from nationally recognized school Improvement projects. Project 
RISE in Milwaukee and the School Improvement Project in New York, was exam- 
ined. Both projects spent over a year planning at the school level before 
implementation and had a great deal of district support. In comparison to 
these projects, Ope,rat1on Turnaround seems to have lacked sufficient school 
level planning and'^'di strict support. For example, the literature from the 
projects mentioned above describe the assignment of planning and consulting 
staff to each school and a series of continuing leadership training ses- 
sions for administrators. It appears that the activities in Operation 
Turnaround were just a small part of these schools' daily concerns. What- 
ever changes h^ve occurred at Operation Turnaround schools have not been of 
a sufficient magnitude to have been measured in this evaluation. This is 
not to say that change has not occurred, but that it has not been demon- 
strated by the performance measures or attitudinal measures which have been 
described in this report. Operation Turnaround has been an ambitious pro- 
gram which may still be in its developmental phase. 

Recomtrendations 

1. Since program implementation in various areas has not occurred as 
quickly as the school staff had anticipated and because this per- 
ceived lag may have affected the morale of program staff, it is 
recommended that evaluation be continued as full implementation 
occurs. ! 

2. It is recommended that individual school level comprehensive 
plans, focusing on instructional programming, be developed for 
Operation Turnaround schools. (Examination of the planning pro- 
cess reported by Project Rise and the School Improvement Project 
may be useful here. ) 

3. It is recommended that school level evaluation and monitoring 
plans be developed in consultation with the Office of Educational 
Accountabi 1 ity . 

4. It is strongly recommended that parent Involvement be increased 
possibly through an outreach program. 
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Description of the Project 



Background 

Operation Turnaround was conceived in response to the particularly poor 
results of the State Student Assessment^ tests during the 1979-80 school 
year. From among 53 deficient element^ary schools three were selected 
according to criteria established by the Division of Elementary and 
Secondary Instruction (DESI). 

These three schools. Holmes Elementary, Little River Elementary, and 
Orchard Villa Elementary were, according to the DESI, in a long term de- 
cline on measures of achievement despite previous efforts which included 
major additional resources and special programs. 

A summary of the Educational Audit findings as reported by DESI are pre- 
sented below: 

In each of the schools, student achievement levels had declined 
significantly over the years. It appeared that the longer stu- 
dents remained in these schools, the lower their achievement 
levels became in comparison with national norms. 

Parent and community participation in these three schools ap- 
peared to be minimal or nonexistent, despite the strong empha- 
sis on these areas which was given at each school. School van- 
dalism was also reported as exceptionally high. 

Common to all three schools was an apparent and pervasive atti- 
tude on the part of the majority of teachers that the students' 
bacl^ground, emotional problems, poverty, and home condi tlon were 
sufficiently negative to prevent real learning or high achieve- 
ment. 

Observation of teacher effectiveness at each school resulted in 
the realization that the teaching faculties appeared to fall 
into three categories; 1) teachers who required only minimal 
training in instructional techniques to become effective teach- 
ers; 2) teachers who themselves lacked the requisite basic 
skills in terms of their own capacities to read, write, and 
speak effectively; and 3) teachers for whom no discernible at- 
tributes for teaching could be observed. 

From this investigation arose the concept of establishing a pilot project 
which would bring about a change in what was described as an "alarming" and 
"distressing" situation. 

Planning . After the target schools were identified, several planning meet- 
ings were held during the months of April, May, and June of 1980. These 
meetings were attended by representatives of the Superintendent of Schools, 
the DESI, the Office of Federal Project Administration, the United Teachers 
of Dade, the Personnel Department, the DCPS Teacher Education Center, the 
DCPS/FIU Teacher Corp, and administrative representatives from the North 
Central area office. 



ERIC 



5 

1l 



Goals . Two major interventions were proposed in these planning sessions as 
means to specific goals. One Involved rebuilding school staff and the oth- 
er was to implement intensive summer in-service training for teachers and 
school level administrators. The goals of the project were also drafted at 
these planning meetings and were as follows; 

1. to raise significantly the achievement levels of students 
at Orchard Villa, Holmes, and Little River Elementary 
Schools; 

I 

2. to develop positive staff perceptions at the three schools 
with respect to the children they teach and the children's 
potential for growth; 

3. to build at each school a cohesive, committed and competent 
staff which would operate as a team; 

4. to significantly increase parent involvement at the three 
schools and to develop an improved sense of community pride 
In each of these schools; 

5. to instill in each child at the three schools a love for 
learning and a belief in self-determination and achievement 
of goals. 

Actions Taken . The following actions were then undertaken to realize these 
goal s : 

1. The Personnel Department was requested to grant transfers 
to any of those teachers who had previously requested them. 
Within the DCPS and UTD guidelines and negotiated proce- 
dures, a total of forty teachers were voluntarily or invol- 
untarily transferred to other school j ocatlons throughout 
the county during the planning stages^of the project. In 
addition, at the request of the building administrators six 
marginal teachers were observed In the spring of 1981 by 
the reading and mathematics supervisors from the Department 
of Basic Skills. Two of the teachers who were evaluated as 
unacceptabl** subsequently left the school. 

2. Unexpended stace textbook funds were utilized to update the 
school's inventories of instructional materials. 

3. Physical plant repairs and improvements were initiated 
through the use of already budgeted funds. These included: 
repainting buildings, installation of steel security doors 
on classrooms vulnerable to vandalism, repair of all broken 
audio-visual equipment, repair and refurbishing of lavato- 
ries, installation of additional security lights, refur- 
bishing art and music rooms at all three schools, and pro- 
vision of a communication system between Holmes' main 
building and portable classrooms. 
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4. For the 1982-fe3 schopl year, nine additional teachers were 
provided to reduce class sizes in grades 4-6. A resource 
teacher position was established at each school to assist 
in curricul um ' improvement . Each teacher at these schools 
now is eligible to receive a $500 incentive payment if all 
criteria specified in the UTD contract are met. 

Organization . Operation Turnaround exists as an organizational entity in 
the form of a coordinating council consisting of the principals, union 
stewardi., area directors from the three schools, as well as other repre- 
sentatives from the United Teachers of Dade and the Bureau of Education. 
In addition, through waivers of the teachers contract in regard to the 
provisions, for faculty councils, the school steering committees at Opera- 
tion Turnaround schools are more widely representative of the teaching 
faculty. 

It is through the three school steering committees that teachers were to 
have input to the decision making process at the school level. The coordi- 
nating council was to oversee the development of Operation Turnaround and 
continues to serve as the problem solving group for the project. 

Financial Aspects . Monies spent on Operation Turnaround have come from 
several sources. The initial outlay was for a four week inservice for 
twenty teachers in the summer of 1980. Teacher salaries were provided by 
carry-over Title I funds. Each school sent an assistant principal whose 
salary came from the summer school budget. The inservice itself was funded 
by the Teacher Education Center. 

The salary funds for the second inservice in August of 1981 also were pro- 
vided through Title I and amoiinted to $90,000.00 not including persons on 
12 month salary and administrators. 

"The DESI requested that a portion of the textbook funds allocated by the 
State be reserved to serve the needs of these schools." Instructional 
material amounting to $43,880.54 was ordered for the three schools (DESI, 
1980). 

In 1981-82 local funds of $100,000 were divided among the three schools and 
funding for a resource teacher and several other teachers to reduce class 
size was allocated. Also, teachers meeting certain Union criteria receive 
a $b00 a year bonus. 

Physical plant maintenance and repair was provided under regular funding 
although priorities for work (A/C for example) have been heightened for 
Operation Turnaround schools. In 1982-83 a special budget line was created 
for Operation Turnaround totalling $549,805. (See Appendix A.) 
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Description of the Evaluation 



Comparison Schools 

This evaluation is a retrospective or a posteriori study since the only 
measures available prior to the beginning of Operation Turnaround are 
achievement measures. One wSy to overcome this difficulty Is to compare 
the group to be evaluated with a different but similar group. It was de- 
cided to use such a procedure in the evaluation of Operation Turnaround. 

Several criteria were established in order to identify schools which could 
be compared to the Operation Turnaround schools: economic ranking accord- 
ing to the percentage of free or reduced lunch recipients, geographic loca- 
tion, and failure to meet state adopted minimum performance levels in at 
least one grade and subject area on the October 1979 State Student Assess- 
ment test. Fifteen schools met these criteria and after further narrowing 
of this field through an examination of current test results and site vis- 
its, three schools were chosen as being roughly comparable to the Operation 
Turnaround schools. It is important to state that these schools are not 
precisely matched to Operation Turnaround schools but, within the paramet- 
ers established, it is believed that they provide some body of data to_ 
which Operation Turnaround schools can be compared (Table 1). 

The three schools chosen as comparison schools were L. C. Evans Elementary, 
Poind ana Park Elementary, and Phyllis Wheatley Elementary. All these 
schools are in the top 25 schools in terms of percent receiving free or re- 
duced price lunches, they are located in the North Central area, and were 
deficient on the 1979 State Student Assessment test. In addition, the 
principals at these three schools agreed to participate in this effort. 

Data Sources 

The evaluation of Operation Turnaround has been addressed by the Office of 
Educational Accountability (QEA) using several different approaches and 
data sources so as to encompass the stated goals of the program. 

Teachers . Teacher attitude and perceptions were a second major focus of 
this evaluation. The goals developed for Operation Turnaround included 
changes in teacher perceptions regarding the quality of the schools, the 
potential of the students, and aspects of job satisfaction. A teacher 
questionnaire was developed with these areas of concern as primary targets. 
In addition, other aspects of the questionnaire were designed to measure 
factors which were considered significant components of the teaching envi- 
ronment. Included was a measure of the degree of support teachers feel 
they have from coworkers and administrators, a measure of the perceived re- 
lationship between behavior and the consequences of that behavior for an 
individual and a scale rating the programmatic and physical aspects of 
Operation Turnaround for teachers in those schools. 
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TABLE 1 

OPERATION TURNAROUND SCHOOLS AND COMPARISON SCHOOLS 
BY SELECTED CRITERIA 





Holmes 


Little 
River 


Orchard 
Villa 


L. C. Evans 


Poinciana 
Park 


Phyl 1 i s 
Wheat ley 


School 
Membershi p 


639 


993 


801 


524 


847 


701 


#F/R Lunches 


592 


856 


712 


484 


797 


668 


%F/R Lunches 


92.642 


87.21 


88.89 


92.29 


94.09 


95.29 


Economic 
Ranking of 
% F/R 
Lunches 


11 


24 


21 


13 


7 


3 


State Student Assessment - October 1979 Average Percent Mastery 




Grade 3 














Reading 


68 


59 


69 


81 


80 


86 


Writing 


75 


67 


71 


81 


81 


96 


Math 


78 


71 


72 


92 


86 


94 


Grade 5 














Readi ng 


60 


56 


53 


67 


66 


64 


Wri t1 ng 


61 


63 


58 


75 


72 


74 


Math 


64 


62 


68 


78 


79 


75 




Hoi mes 


""TTtTTe" 
R1 ver 


"Orchard 
Villa 


Lo C. Evans 


Pol nci ana 
Park 


TFyll is 
Wheat 1 ey 




This questionnaire was delivered to teachers by members of the OEA staff at 
faculty meetings. The staff members explained the purpose of the question- 
naire and answered any questions posed by teachers. Teachers were request- 
ed to respond to the questionnaire and return it directly to the OEA by 
school mail. In order to provide an option for personal follow-up inter- 
views, the teachers were asked to provide their names on the questionnaire. 
Despite assurances of confidentiality, this caused some difficulty. Due to 
the nature of the results, follow-up interviews were not initiated. 

A modified version of this questionnaire was given to the principals at the 
six schools. The principals' quest'onnai re concerned primarily teacher- 
administrator relationships and programmatic evaluation. 

Students 

Achievement . Since student achievement has probably the highest priority 
and was in fact the main selection factor for Operation Turnaround, a care- 
ful examination of the trends of scores on the Stanford Achievement test 
and the State Student Assessment test was carried out. 

Stanford Achievement scores were examined beginning with scores from the 
1978 Spring administration through the 1981 Spring administration using 
scale scores which allow comparability across test levels. The Spring 1982 
and 1983 administration used the 7th edition of the Stanford while the pre- 
vious scores were from the 6th edition. Direct statistical comparisons be- 
tween the 6th and 7th editions of the Stanfords are not available due to 
changes in the scale score metric; however, . this will be possible in the 
near future. Percentile ranks were compared for the more recent Stanford 
results. Stanine changes were also examined. 

The State Student Assessment results were examined from 1977-78 through the 
1982-83 administration. These tests are administered in the third and 
fifth grade. The average percent mastery scores were examined graphically 
for all six schools individually and then combined for the Operation 
Turnaround schools and the comparison schools. Both groups of schools were 
also compared to districtwide scores. 

Affect . Aside from academic progress. Operation Turnaround planners hoped 
to improve student attitudes toward school, themselves, and learning. In 
order to investigate this aspect of the program, several scales were used. 
The first was the School Morale Attitude Survey. This is a DCPS instrument 
which has a Primary Form and an Elementary Form, The Primary Form breaks 
up into two subscales: School Morale and Self as Learner. The Elementary 
Form has four subscales: School Morale, Self as Learner, Instruction, and 
Physical Plant. The second instrument, a scale entitled "Who Helps You," 
presents one-sentence situations which call for the student to choose from 
a list of people the one most likely to help them in that situation. This 
instrument was used in an attempt to get some measure of the strength or 
significance of student association with various school figures. 

The final instrument used is called the Intellectual Achievement Responsi- 
bility Scale. This scale examines the extent to which an individual ac- 
cepts or denies personal responsibility for positive and negative outcomes. 
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These student scales were administered to a sample of students with the 
cooperation of their teachers. One class in each grade at all of the six 
schools was randomly selected to respond to the scales. Only students in 
grades 4-6 responded to the Intellectual Achievement Responsibility Scale. 
All students responded to the "Who Helps You" scale and the School Morale 
Attitude Survey. 

Parents . A small number of randomly selected parents of children who at- 
tended an Operation Turnaround school in the 1982-83 school year were con- 
tacted by telephone. In a very short interview their degree of awareness 
of the school and Operation Turnaround was ascertained. 

Other Data . Three other sets of data were studied. One ws^s/ attendance 
records for the six schools from 1977-78 to 1982-83. The second was 
records of vandalism and violent incidents at these schools. It was felt 
that this latter data might provide some evidence of the community response 
to Operation Turnaround. Finally, the numbers of teachers who transferred 
in and out of each of the six schools were examined in an effort to evalu- 
ate the degree of faculty stability at Operation Turnaround schools and 
comparison schools. 

The collection and analysis of the data described above enabled response to 
the following evaluation questions: 

1. What impact has Operation Turnaround had on the achievement 
of project students in comparison with previous years and 
with students at simiiar schools? 

/ 

2. What are the project and tomparison schools' staff percep- 
tions regarding the currefit status of such success-depend- 
ent factors as staff cohesi veness , teacher-administrator 
relationships, student potential, administrative support to 
teachers in the maintenance of classroom control and other 
factors of job satisfaction? 

3. To what extent have Operation Turnaround schools' staff 
turnover rates changed and how does it compare to similar 
school s? 

4. What changes have occurred in reports of violence/vandalism 
occurring in, or directed at. Operation Turnaround schools 
and comparison schools? 

5. To what degree have parents become aware of Operation Turn- 
around and what kinds of written or verbal communication 
have they had from the schools? 

6. Has Operation Turnaround enhanced program students' affec- 
tive orientation toward school, school staff, and them- 
selves as learners as compared to that of students at simi- 
lar school s? 

7. Has attendance changed at Operation Turnaround schools and 
comparison schools? 

What are project school administrators' and teachers' per- 
ceptions regarding the relative efficacy of the various 
project features and to what extent were these features 
seen as actually implemented? 

U 
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Resul ts 



The results of this evaluation will be presented in terms of the questions 
which were proposed. 

The Impact of the Program Upon Student Achievement 

State Student Assessment Tests . Documentation descriptive of Operation 
Turnaround indicates that among other data, deficient scores on the 1979-80 
State Student Assessment test had signaled the need for intervention in 
what were to become the project Turnaround schools. In order to examine 
changes in State Student A«>sessment results, data were gathered for the 
years 1977-78 through 1982-83. The 1977-78 results were from an earlier 
form of the State Student Assessment tests and were reported for two sub- 
tests: Mathematics and Communication Skills. Subsequently the test re- 
sults are reported for three subtests: Reading, Writing, and Mathematics. 
Three data sets were examined: The scores for Operation Turnaround 
schools, the scores for the three comparison schools, and districtwide 
scores (see Appendix B for individual school scores.) 

The results on the State Student Assessment tests are reported as average 
percent mastery and are highly skewed which is expected since the emphasis 
on basic skills instruction directed specifically at these minimal objec- 
tives provides the maximum opportunity for students to exhibit appropriate 
minimal skills. Table 2 presents the means of the three sets of data by 
year. These means are also graphically displayed in Figures la, lb, and 
Ic. Inspection of the districtwide scores indicates that the highest 
scores occurred in the 1978-79 testing and then declined slightly, remain- 
ing in the 80 to 90 percentage range. Since this graph represents a large 
number of schools it was expected that variations would be minimal; a 
slight decline was, however, noted in 1979-80. Upon inspection of the ta- 
ble and graphs of the Operation Turnaround schools and the comparison 
schools (which contain a smaller number of scores) this decline assumes a 
greater magnitude. 

Figure la compares the third grade mean scores of the two sets of schools. 
The comparison schools have a fairly stable pattern with a slight decline 
in Reading and Writing in 1979-80 and a slight rise in Math, but generally 
staying within the 80 to 90 average percent mastery level. There is also a 
slight rise above this level occurring in the last year for which data was 
available (1982-83). The Operation Turnaround schools present a very simi- 
lar pattern of results except for the 1979-80 testing. In that year there 
appeared to be a relatively large, as yet unexplained, drop in test perfor- 
mance. At the time of the next testing (two months after the onset of 
Operation Turnaround) this group returned to its previous level of perfor- 
mance, maintaining a stable pattern in the 80 to 90 percent range with a 
very slight rl'^e noted for the 1982-83 testing. 
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Figure ta State Assessment Test Third Grade In Operation Turn- 
around and Comparison Schcols, 1977-78 Through 1982-33 




Figure lb State Assessment Test Fifth Grade In Operation Turn- 
around and Comparison Schools, 1977-78 Through 1982-83 
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Figure 1c Stato Assessment Test Olstrlctwide Scores for Third 
and Fifth Grades, 1977-78 Through tM2-63 
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Figure 2a State Assassnmnt Test Scores from Operation Turnaround 
and Comparison Schools Subtracted From Olstrlctwfde 
Scores for Third Grade, 1977-78 Through 1982-83 Scores 
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Figure 2b State Assessment Test, Scores from Operation Turnaround and Com- 
parison Schools Subtracted From Dlstrlctwlde Scores for Fifth 
Grade, 1977-78 Through 1982-63 
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TABLE 2 



AVtRAGE PERCENT MASTERY SCORES FOR THE STATE ASSESSMENT TESTS FOR DISTRICT, OPERATON TURNAROUND SCHOOLS. 

AND COMPARISON SCHOOLS FOR 1977-78 THROUGH 1982-83 



Third Grade 



Grade 


Oct. 77 


Oct. 78 


Oct. 79 


Oct. 80 
Program Start 


Oct. 81 


Oct. 82 










C 




M 


R 


W 


M 


R 


W 


M 


R 


U 


M 


R 


W 


M 


R 


W 


M 


District 








77 




89 


93 


95 


91 


86 


90 


89 


86 


89 


88 


88 


90 


88 


88 


93 


89 


Operation 
Turnaround 








60 




81 


83 


89 


86 


64 


71 


74 


84 


87 


88 


84 


87 


91 


91 


94 


91 


Comparison 








59 




81 


84 


91 


90 


82 


86 


91 


83 


85 


89 


87 


88 


91 


93 


93 






Oct. 77 


Fifth G 
Oct. 78 


rade 

Oct. 79 


Oct. 80 


Oct. 81 


Oct. 8 


2 










C 




M 


R 


W 


M 


R 


W 


M 


R 


W 


M 


R 


W 


M 


R 


W 


M 


District 








75 




77 


90 


89 


86 


82 


83 


84 


84 


85 


83 


85 


86 


83 


87 


87 


85 


Operation 
Turnaround 








51 




56 


75 


76 


74 


56 


61 


65 


66 


73 


69 


76 


78 


76 


81 


81 


81 


Compari son 








49 




57 


71 


69 


72 


66 


/4 


77 


77 


60 


82 


77 


80 


79 


82 


83 


82 
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The pattern of fifth grade scores for the District is quite similar to that 
of the third gr"aHe^ mere is a slight decline in 1979-80 and then a rise 
back to the 1978-79 level. The fifth grade scores of the comparison 
schools and Operation Turnaround schools were somewhat lower overall than 
those of the district and showed greater variation, which again is to some 
extent due to the relatively small numbers of students in these schools 
(compared to the District as a whole). The comparison schools show a small 
decline in reading in 1979-80, followed by a recovery back to a level 
slightly above that of 1978-79. Math and Writing scores do not show a de- 
cline in 1979-80» but the Math scores declined sharply In 1980-81 and then 
rose back to the level of the other subtests. The fifth grade in the Oper- 
ation Turnaround schools had higher overall test scores in 1978-79 than did 
the comparison schools, but exhibited a sharp decline the following year, 
1979-80. Again, as with the third grade pattern, the 1980-81 test results 
exhibited a rise which has continued on up to the latest (1982-83) testing. 

As a final illustration of this pattern of test results, Figure 2 depicts 
the results of subtracting each mean test score of the Operation Turnaround 
and comparison schools from the districtwide test score. The districtwide 
scores then are represented by the solid horizontal line across the two 
graphs with scores below the line being lower than the district scores and 
those above the line being higher. The same patterns discussed above are 
evident in this representation of the data. 

In summary , the pattern seen for the State Student Assessment tests is that 
after a high point with the new form of the test In 1978-79, there was a 
slight districtwide decline In test s-cores which was extreme in the Opera- 
tion Turnaround schools. The comparison schools did not have a general de- 
cline. This was followed in the next year by a general rise in scores 
which has continued in both Operation Turnaround schools and comparison 
schools. 

It is not possible, at this point in time, to determine if the extreme 
decline in SSAT scores in 1979 for the Operation Turnaround schools was the 
beginning of a trend or If It was due to an isolated incidence. While it 
Is possible that the decline was due to an unidentified problem which was 
alleviated by Operation Turnaround, it is also possible that the decline 
was an isolated incidence which corrected itself without the benefit of 
Operation Turnaround. Given the short time period between program onset 
and the testing (one month) and the similarity of the subsequent trends for 
Operation Turnaround and comparison schools, for both SSAT and the Stanford 
Achievement Test (see below), 1t cannot be assumed that either the recovery 
in 1980 or the subsequent increase was a function of program influence. 

Stanford Achievement . The Stanford Achievement test results present a much 
more cljmplex picture than does the State Student Assessment test. First, 
all grades are tested; second, testing has occurred at different times of 
the year; third, the Stanford tests a broader range of competencies than 
the State Student Assessment; and fourth, a new edition of the test came 
into use in the 1981-82 school year. 

Several approaches were attempted to Investigate various questions regard- 
ing the pattern of performance prior to and subsequent to the inception of 
Operation Turnaround, both for program schools and comparison schools. An 
attempt was made to establish a baseline and to demonstrate comparability 
between the program and non-program schools; and to discover any perfor- 
mance shifts that might be attributable to Operation Turnaround. 



Usually reported for the Stanford are median percentile ranks for every 
grade of a school. This score represents the position of that particular 
grade in terms of the national norms for that grade. For example, if a 
grade's median percentile rank is 34» that means that, on a national level, 
34 percent of all scores are at or below that grade's median percentile 
score. ^ addition, that score indicates that within that grade level 50 
percent ofSlhe scores are at the 34th percentile rank or below. The median 
percentile rift^s for 1977-78 through 1981-82 for Reading and Math Computa- 
tion are present^ii.4n Appendix C for the three Operation Turnaround schools 
and the three compart56oschool s. 

Although these percentile ranks locate a score within the national distri- 
bution of scores and it is then possible to visually or descriptively plot 
changes in percentile ranks in relation to the national norms, these scores 
do not lend themselves to statistical analysis. In order to analyze this 
data, scale scores were used which allow for statistical analysis across 
levels, time, and groups. For this analysis, the student population was 
restricted to those students who were members of one of the Operation Turn- 
around schools or one of the comparison schools in 1980-81 and who had at- 
tended that same school for every year back to 1978. In addition, the 
analysis was restricted to the Reading and Math Computation subtests. The 
population of students numbered 701 for the Reading subtest and 717 for the 
Math Computation subtest. The students in this population were in the 
first, second, and third grade in 1977-78 and the fourth, fifth, and sixth 
grade in 1980-81. A 2(Program by non-Program) X 3(Grade in 1977-78) X 
4(The four years from 1977-78 to 1980-81) Analysis of Variance, with re- 
peated measures on the last factor (years), was performed on this data. 
Thus, each student in this population was tested four times, once each year 
for four years. This analysis takes into account whether or not the stu- 
dent is attending an Operation Turnaround school or a comparison school, 
the group of students (by grade in 1977-78) which was followed for the four 
years of data, and the changes in the scores over the four tests. Two 
analyses were performed, one for the Reading subtest and one for the Math 
Computation subtest (see Table 3), 

The four years for which data was analyzed encompassed three years prior to 
the onset of Operation Turnaround and one year after it had begun. It was 
expected that this analysis would enable determination of a baseline and 
the comparability of Operation Turnaround and comparison schools, and sub- 
sequent determination of whether any changes had occurred after Operation 
Turnaround began. 

The analysis of the Reading subtest indicates that various differences ex- 
ist. There was a significant main effect for Program, F( I ,695) =5. 45 p= 
.02, Grade in 1978, F(2,695)=144.81 p < .0001, and for the tests over time, 
F(3,2085)=566.38 p < .0001. What this indicates is that Operation Turna- 
round schools differ from comparison schools collapsing the different 
grades and tests over time. In order to further examine this result, T- 
tests were performed comparing all the grades of thv. Operation Turnarouna 
schools to all the grades in the comparison schools for each test. This 
yielded some rather interesting results. On the first three tests (1977- 
78, 1978-79, and 1979-80), the schools which were to be Operation Turna- 
round schools had significantly higher mean reading scores than the compar- 
ison schools (see Table 3) while on the last test, in 1980-81, there was no 
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TABLE 3 

STANFORD ACHIEVEMENT TESTS MEANS* OF SCALE SCORES 
Students in Attendance in 1977-78 and in Same OPERATION TURNAROUND or COMPARISON 

Schools In 1980-81 



Grade 
in 
1978 


Operation 
Turnaround 


T 

Compari son 


Operation 
Turnaround 


ND 

Compari son 


Operation 
Turnaround 


b 

Comparison 


77-78 


105.97 


104.13 


125.32 


11?. 76 


129.12 


128.01 


78-79 


120.45 


117.79 


131.34 


131.18 


135.66 


134.66 


79-80 


128.42 


126.71 


137.77 


138.19 


147.26 


142.71 


80-81 


136. ?4 


132.76 


147.26 


142.71 


157.23 


151.43 


Math Co 


mprehension 






77-78 


123.60 


117.02 


137.79 


133.16 


142.861 


151.71 


78-79 


134.08 


133.40 


145.33 


145.62 


147.76 


160.59 


79-80 


140.49 


140.34 


151.39 


153.58 


159.10 


166.48 


80-81 


146.56 


158.74 


158.74 


161.95 


166.21 


166.03 


*Rounded 



ANOVA Summary Table 
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statistically significant di ffereryfe, however, the pattern remained the 
same with the Operation Turnaroun(^ schools having a higher mean score than 
the comparison schools. Figure 3a is a graphic representation of this 
analysis. The. T-tests discussed above represent a combination of those 
three sets of lines into just two, one for the Operation Turnaround schools 
and one for the comparison schools. In looking at the three sets, the dif- 
ference between these two groups of schools is evident. Except in the 
group followed from the second to the fifth grade where there is a small 
reversal starting in 1979, the Operation Turnaround schools had higher 
reading scores. This then accounts for the difference between ..Uie Opera- 
tion Turnaround schools and the others in the analysis of variantB^^The 
graph also makes clear the significant grade and time results of xhat 
analysis. \ 

Scale scores are adjusted for grade so that there would be expected in- 
crease : in scores as the students are tested at each grade level. Thus, 
the m. lian or 50th percentile scale score increases for each grade level. 
The analysis of variance performed above indicated that there was an inter- 
action between tme tested and grade, F(6,2085)=*5.26 p < .001, and the time 
tested, grade, and Operation Turnaround "or comparison school membership, 
F(6,2085)=3. 11 p < .005. An interaction would generally mean that the re- 
lationships between the grade groups and the two sets of schools differ at 
the different times they were tested. This finding may be reflective of 
the "built in" increase in scale scores from one grade to the next. 

There seems to be in this data an obvious difference between the lower 
three grades and the upper three grades (Fig. 3a). This difference, plus 
the comparison schools crossover in the middle three grades in 1979-80 may 
explain the interaction as more a reflection of maturation than anything 
else. • - 

Analysis of the math scores indicate significant main effects for the Oper- 
ation Turnaround vs. the comparison schools F{ 1,71] ).=4. 24 p < .04, the 
grades in 1978 F(2,.71i)=264.42 p < .001 and the time or year of testing 
F(3,2133)=600.57 p < .001. The schools which were to be designated Opera- 
tion turnaround schools differed from comparison schools and T-tests were 
performed for each testing (combining all grades). An inspection of Table 
3 and Figure 3b reveals that the pattern for the math scores is similar to 
that of the reading scores at least for the lower two sets of grades in- 
cluding the crossover in 1979-80 at which point the comparison schools had 
higher scores. The last group of students followed from the third grade 
through the sixth grade seems different. In the T-tests, the superiority 
of the comparison schools in that group seems to be offset by the smaller 
differences in the other two groups in which Operation Turnaround schools 
have the higher scores except for 1979-80. In that year, the comparison 
schools' math scores were significantly higher. As presented in Table 3, 
interactions were significant for the math scores as they had been for the 
reading scores except that there was also an interaction between the grade 
and school (program or comparison). This is probably the result of the 
pattern of scores for the third to sixths grade group in the comparison 
schools. The rest of the interactions would seem to be explainable by the 
same reasoning as the reading scores. The maturational component built in- 
to the scale scores would be reflected by the comparisons between the 
grades at the di fferent' times of testing. 
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Flgur© 3a Stat© Assessment Test-Reading Comprehension Scale 
Scores From 1977-78 Through 1980-81 For a Group of 
Students at Operation Turnaround Schools and Coa^ 
parlson Schools Who Wore Identified as Having Been 
at the Same School Throughout This Time Period 




Figure 3b Stajiford Achlevemont Test Math Computation Scale 
Scores From 1977-78 Through 1980-61 For a Group of 
Students at Operation Turnaround Schools and Co^r^ 
parlson Schools Who Were Identified as Having Been 
at the Sam© School Throughout This Time Period 




TABLE 4a 



PERCENT OF STUDENTS IN STANINE 1 + 2 IN READING AND MATH OF STANFORD ACHIEVEMENT 

TESTS COLLAPSED OVER GRADES 1-3 and 4-6 



Reading Comprehension 



Math Computation 



77-78 
Gr. 1-3 


Operati 
Turnaro 

Total 
Number 

1002 


on 
und 

%Sta. 

1+2 

10 


Compa 

Total 
Number 

634 


rison 

%Sta. 

1+2 

14 


77-78 
Gr. 4-6 


1027 


26 


966 


21 


78-79 
Gr. 1-3 


915 


17 


737 


19 


78-79 
Gr. 4-6 


911 


22 


727 


19 


7Q-80 
Gr. 1-3 


961 


10 


731 


14 


79-80 
Gr. 4-6 


963 


12 


715 . 


16 


80-81 
Gr. 1-3 


1015 


11 


821 


14 


80-81 . 
Gr. 4-6 


1044 


10 


704 


12 


81-82 
Gr. 1-3 


1065 


24 


797 


25 


81-82 
Gr. 4-6 


1051 


28 


874 


21 



Operati 
Turnaro 

Total 
Number 

1003 


on 
und 

%Sta. 
1+2 

6 


Comp 

Total 
Number 

640 


arison 

%Sta. 

1+2 

9 


1019 


12 


964 


10 


919 


10 


722 


8 


908 


16 


736 


9 


995 


6 


765 


6 


955 


8 


712 


6 


1003 


6 


825 


8 


1033 


7 


717 


7 


1056 


19 


786 


17 


1043 


17 


677 


14 
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TABLE 4b 



PERCENT OF STUDENTS ABOVE STANINE 3 IN READING COMPREHENSION AND MATH COMPUTATION 
OF STANFORD ACHIEVEMENT TESTS COLLAPSED OVER GRADES 2-5 



Reading Comprehension Math Computation 





Operation 
Turnaround 


Comparison 


Operation 
Turnaround 


Comparison 


1977-78 


61 


58 


81 


82 


1978-79 


56 


51 


69 


78 


1979-80 


68 


66 


84 


89 


1980-81 


74 


69 


86 


87 


1981-82 


51 


53 


63 


65 
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In order to examine Stanford Achievement tests in another way, Stanine 
groups were examined. These data are presented in Tables 4a and 4b. Table 
4a displays the percent of students in Stanines 1 and 2 combined. It was 
hypothesized that program impact might be evident in comparisons of the 
pattern of "stanine group membership." Although it is possible that stu- 
dents in Operation Turnaround moved from stanine 1 to stanine 2 the pattern 
of percent of students in the group of stanine (1+2) does not indicate pro- 
gram related shifts. There were no changes in these percentages for Opera- 
tion Turnaround schools that were not paralleled in the comparison schools 
and in almost half of the comparisons prior to the onset of Operation Turn- 
around, those schools (Operation Turnaround) had lower percentages in this 
category than the comparison schools. The same was true of the comparisons 
after the onset of Operation Turnaround. 

The data in Table 4b represent the percentage of relatively high achieving 
students, those above Stanine 3. A visual inspection of fie patterns in 
Table 4b does not Indicate any differences between the Operation Turnaround 
schools and the comparison schools, either before the onset of Operation 
Turnaround or for the two years after it had begun. 

In sunmary , these analyses were carried out in part to determine whether or 
not it would be appropriate to compare the Operation Turnaround schools to 
the schools which had been selected as comparison schools. Of particular 
concern was whether the comparison schools would have been superior at the 
outset. It Is believed that these results do indicate an initial compara- 
bility of the pattern of performance on the Stanford achievement tests. 
There were significant differences here and there, but they were not con- 
sistent. Neither set of schools was clearly superior nor were the differ- 
ences startling. With such large numbers of students, small score differ- 
ences can become statistically significant, but that .does not necessarily 
imply that these differences have practical meaning. For the purposes of 
this evaluation, it seems appropriate to accept the comparability of these 
two sets of schools. The performance patterns for the three years prior to 
the onset of Operation Turnaround do not reveal any substantial negative 
shifts for the schooU which were to be designated as Operation Turnaround 
schools and there were no substantial achievement test score shifts follow- 
ing program implementation. 

Staff Perceptions Regarding Various Success-dependent Factors 

One of the main goals of Operation Turnaround was the alteration of the 
school environment both in terms of the educational/social structure, and 
the physical environment Itself. As was done in the case of the previously 
described achievement analyses, this section utilizes comparisons between 
schools in Operation Turnaround and schools in the "comparison" group. Be- 
fore presenting the data from this questionnaire, it is necessary to quali- 
fy the sample of teachers who responded. The planning of this question- 
naire included the possibility of follow-up Interviews. These Interviews 
were planned only if it was determined that they would add substantially to 
the data. Because specific responses were going to be used to determine 
Interviewees, it was necessary to ask for names on the questionnaire. Al- 
though full confidentiality was promised and specific procedures were fol- 
lowed to maintain the utmost confidentiality, many teachers withheld their 
responses (perhaps because of their reluctance to identify themselves). Of 
approximately 200 teachers, OEA received 85 completed questionnaires, with 
some schools contributing substantially more than others (see Table 5). 
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TABLE 5 



Number of Responses to Teacher Questionnaire* 



Operation Turnaround 




Compari son 




Holmes 


1 


L, C, Evans 


17 1 


Little River 


25 


Poinciana Park 


5 


1 Orchard Villa 


10 


Phyllis Wheatley 


12 



*Nine questionnaires had no school identification. 
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It is thus possible that the responses from those teachers who were willing 
to respond are not characteristic of the rest of the teachers. Therefore, 
any generalizations from the data to be presented must 6e made cautiously. 

With the above being noted, the several parts of the teacher questionnaire 
were examined in light of the goals of the program and the evaluation ques- 
tions. In order to ascertain if teacher perception had Jbeen influenced by 
the Operation Turnaround program, it was necessary to compare Operation 
Turnaround teacher responses to comparison school teacher responses. Our 
interest was in the difference between these two groups. The only area in 
which this was not done was on the section of the questionnaire which was 
concerned with specific aspects of Operation Turnaround as it was only im- 
portant to know how the teachers in the program perceived the various as- 
pects of the program. Responses to each item of this questionnaire are 
presented in Appendix D. 

Student Potential . One of the important aspirations of Operation Turna- 
round planners was to raise teachers' judgements regarding the potential of 
their students. The analysis of these responses as well as responses to 
other areas of interest involved an overall comparison of the Operation 
Turnaround schools' responses to the comparison schools' responses as well 
as an individual analysis of all six schools to determine the pattern of 
schojol by school responses. Of the nine items which were reflective of 
perceptions of student potential, significant differences in responses fa- 
vorable to Turnaround schools occurred for only two items related to the 
extent to which students were: 1) seen as liking to be at school; and 2) 
expected to finish high ..school . Specific to the first item statement. 
Operation Turnaround teachers perceived this as being more like their stu- 
dents (mean=4.07) than did the comparison teachers (means3.47), T(74)=2.91 
p < .005. The analysis of variance of all six schools yielded a signifi- 
cant difference among the schools for this response {F(5,70)»3.009= p < 
.0162 and follow-up analysis Indicated that the schools showing the great- 
est difference was between Little River, an Operation Turnaround School 
) (mean=4.08) and Wheatley, a comparison school (mean=3.08) using the Tukey B 
1 procedure. In terms of the second item, although there was not an overall 
difference between the Operation Turnaround teachers and the comparison 
teachers, the school by school analysis was significant F(5,70)=2.376 p < 
.0475, with Little River and a comparison school L.C. Evans {means=3.68 and 
3.76) being differentiated from Wheatley (mean=2.83) p < .05 using the Tu- 
key B procedure. These are not overwhelming differences for teachers' per- 
ceptions of their students and their students' potential. 

Teachers' Sense of Support . Another goal for Operation Turnaround teachers 
was to increase their sense of cohesi veness. In order to assess this, a 
series of items, derived from previous research, was incorporated in the 
teacher questionnaire. After a series of general questions, teachers were 
asked to define for themselves a significant co-worker, administrator, and 
an "other" school person. They were then asked to rate those people on 
various dimensions to define the quality of their relationships. Responses 
to these questions were analyzed by creating four variables from all of the 
questions. The first assessed the general level of support experienced by 
responding teachers, the second combined responses specific to co-workers, 
the third responses specific to administrators, and the fourth, responses 
specific to "other" personnel. Results from the analysis performed on re- 
sponses to Items encompassed by this latter area are uninterpretable and 
are not further discussed. 
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Teacher support . There was a difference between the Operation Turna- 
round TcHooTIanocompari son schools on the combined score for the three 
general support questions. On these questions, a high score means more of 
a feeling of support. The Operation Turnaround teachers have a lower mean 
score (2.91) than the comparison school teachers (3.30), T(74)=2.26 p=.027. 
The analysis of variance of the six schools is also significant, F(5,70) = 
3.15 p*.0127 with the significant difference between the schools being be- 
tween L.C. Evans (mean=3.47) and Little River (mean=2.72). For Items spe- 
cific to co-workers., no differences were noted. 

Administrative support . The only other difference on the social 
support sections involved support from administrators. In these questions 
the lower means indicate a greater perception of support. The Operation 
Turnaround teachers seem to perceive having less support from their admin- 
istrators (mean=2.50) as opposed to the comparison school teachers (mean= 
1.86), T(74)=2.60 p=.011. This result is mitigated by the fact that on the 
analysis of the six schools which was also significant, F(5,70)=4.63 
p < .001, the schools showing differences were L.C. Evans (1.62), Orchard 
Villa (1.84), and Phyllis Wheatley (2.03) perceiving greater administrator 
support than Little River (2.95). Although there was not a significant 
difference between Operation Turnaround Teachers and comparison teachers on 
perceived support from other professionals, the analysis of the six schools 
indicated again a difference between L.C. Evans (mean=sl.37) and Little 
River (mean=2.73). Indicating that the teachers at. L.C. Evans feel more 
support from other school professionals. 

In conclusion, results of these analyses indicated that Operation Turna- 
round teachers perceived: 1) significantly less general support within 
their schools, and 2) significantly less support from their administrators 
than did teachers of the comparison schools. Although there are signifi- 
cant differences on the measures of teacher cohesiveness with each other 
and administrators the differences seem to center about two specific 
schools. Little River, an Operation Turnaround school, and L.C. Evans, a 
comparison school. What this may mean is that individual school^ differ- 
ences may be overriding any influence of the Operation Turnaround interven- 
tions in these analyses. 

Job Satisfaction . In the section of the questionnaire dealing specifically 
with job satisfaction, the only areas which distingu-ished Operation Turna- 
round teachers from the comparison school teachers were the questions re- 
garding administrative relationships. These results and the responses to 
the specific questions related to administrative Interaction can be viewed 
together. 

In both items in which teachers were asked to rate the degree of satisfac- 
tion associated with their relationships with school and area/county level 
administrators, the comparison school teachers indicated greater satisfac- 
tion with these relationships. In terms of school level administrators the 
mean rating given by Comparison school teachers was 4.30 (on a five point 
scale, five being the highest rating) and the mean for the Operation Turna- 
round teachers was 3.5, T(73)=3.76 p<.001. For the area level administra- 
tors the mean for comparison schools was 3.48 and for Operation Turnaround 
3.04, T(73)=2.22 p<.029. On another item in which teachers were asked to 
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rate their satisfaction with the extent of administrative or other in- 
school resource personnel assistance with disruptive students' behavior, 
comparison school teachers rated themselves as significantly more satisfied 
(mean=4.029) than Operation Turnaround teachers (mean=3.00), T(74)=3.46 
p<.001. 

On all three of these items we found the same pattern on the analysis of 
variance of the six schools. Two of the above items yielded significant 
results, while the question on area administrators only approached signifi- 
cance F(5.69)= 3.627 p=.0057; F(5,69)=2.283 p=.0558; F(5,70)=3.387 p=.0085, 
respectively). As above, of the six schools the two that are significantly 
different are L.C. Evans and Little River, with L.C. Evans having higher 
satisfaction means. Thus, whether these results actually relate to Opera- 
tion Turnaround as a program is quite unclear. Three other responses spe- 
cifically related to principal support show the same results with the com- 
parison school teachers generally reporting the principal providing more 
frequent assistance, making more suggestions regarding instructional meth- 
ods, and being more supportive of in-service training efforts. (See appen- 
dix D). In addition, in response to questions asking whether or not the 
principal would support them ("go to bat" for them) with the district, nine 
Operation Turnaround teachers said no while none of the Comparison school 
teachers said no. This difference was significant Chi2(i)=6.48 p<.01. 

In Summary , the results relevant to teachers* sense of support and job sat- 
i taction, tliere appears to be an indication that differences between the 
two groups of schools seem to be in favor of the comparison schools but 
there are strong indications that the greatest difference here may be due 
to a very stable administration at one of the schools. 

Unfortunately, changes in teachers' perception of their working environment 
which may have occurred longitudinally in Operation Turnaround schools can- 
not be measured and comparisons with other schools as a group may be influ- 
enced by variables outside of Operation Turnaround, such as administrative 
stability or style. 

Teach e rs Perception of Operation Turnaround 

The ^-inal section of the teacher questionnaire requested Operation Turn- 
arou.u teachers to rate the degree of implementation and impact of the var- 
ious components of Operation Turnaround. The results of this section are 
presented in Table 6. The teachers seem to have been informed about Opera- 
tion Turnaround and the improvements which were planned. The mean rating 
for degree of implementation after three years was 2.95 on a 5 point scale 
and 2.9 for impact. The lowest rating was for the implementation of air 
conditioning and the highest was for new books and painting. An analysis 
of variance of the responses by school did not indicate differences between 
the Operation Turnaround schools. It is believed that teachers' substan- 
tial knowledge of planned Improvements, coupled with their perception that 
these improvements had not been implemented, may have had a negative effect 
on their total perception of the school climate (see Table 5). 
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TABLE 6 

MEANS OF RESPONSES BY OPERATION TURNAROUND TEACHERS 



These questions concern Operation Turnaround . 

A. To what extent were you made aware of the improvements in your school that 
were to occur as a part of Operation Turnaround. (Check one.) 

1. I was fully informed of all planned improvements related to 
Operation Turnaround. 

2. I was given a general idea of the improvements to be made. 
MEAN = 1.83 3. Most of the .information I had about Operation Turnaround was 

rumor. 

4. I was not informed at all about the improvements planned for 
Operation Turnaround schools. 

The following items were rated on a five point scale. 



DEGREE 
IMPLEMENTED 



Not 

Implemented 



Completely 
Implemented 



New books 


3.54 


Parental Involvement 


2.54 


Media material 


2.86 


New equipment 


2.95 


Building repairs 


3.00 


Electrical repairs 


2.80 


Ai r conditioning 


1.48 


Painting 


3.95 


Staff changes 


3.13 


Safety 


2.93 


Resource teacher 


3.30 



POSITIVE 
IMPACT 



None 



3.33 
2.51 
2.95 
3.15 
3.20 
3.00 
1.67 
3.44 
2.78 
2.83 
3.05 



Very 
Much 



In-service 



Not Enough 



More than 
Adequate 



Frequency 
Rel evancy 
Task Oriented 
Fol 1 ow-up 



2.97 
3.26 
3.08 
2.92 
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Teacher Stability * 

Another measure of teacher satisfaction was the overall stability of the 
teaching staff at the Operation Turnaround and comparison schools. Data 
were gathered for the six schools for the years 1978 through 1981 and the 
number and percentage of teachers who left the schools wereyi^-etd^ated (see 
Table 7). Operation Turnaround schools lost more teachers than did the 
comparison schools in each of the years except in 1980. On the average, 
28% of Turnaround teachers and 23% of comparison school teachers left each 
year. 

Student Affective Measures . 

Operation Turnaround was also directed at improving the attitude of stu- 
dents regarding their school, themselves as learners, and their attitude 
towards the staff. This evaluation used three scales to examine the stu- 
dents' attitudes. The first was an instrument developed by DCPS called the 
School Morale Attitude Survey. This scale has two forms: a primary form 
which was given to first through the third grade and an elementary form 
which was given. to the fourth through fifth grade (see Appendix E). Data 
were collected from 282 students in the Operation Turnaround schools and 
366 students in comparison schools. The results are presented in Table 8. 

The primary form has two subscales and the elementary form has four sub- 
scales. The School Morale Subscale indicates the extent to which pupils 
enjoy attending school. An inspection of Table 8 reveals that students in 
the lower grades show a greater percent of positive responses to this scale 
than the uppper grades and in the lower grades, the Operation Turnaround 
students seem a little more positive. In the upper grades, the comparison 
schools' students make slightly more positive responses than the Operation 
Turnaround students. On the Self as Learner subscale, positive responses 
indicate the degree to which pupils view themselves as learners. Again, 
the lower grades have a higher percentage of positive responses than the 
upper grades. There is no difference in the lower grades between the Oper- 
ation Turnaround school students and the comparison school students. In 
the upper grades, the comparison schools have a slightly higher percentage 
of positive responses, but the difference is negligible. 

In the elementary form, there are two more subscales. Physical Plant re- 
flects the pupils' perceptions of the adequacy of the physical structure of 
the school building. On this scale, the Operation Turnaround students are 
slightly lower than tha comparison school students, but this difference 
reflects less than one response. The same is true of the Instruction sub- 
scale. This subscale reflects pupils attitudes toward the school's in- 
structional program. It does not appear that there are any meaningful 
differences on this instrument between the Operation Turnaround students' 
positive attitudes and the comparison students' positive attitudes. 
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TABLE 7 



NUMBER AND PERCENT OF TEACHERS WHO LEFT OPERATION TURNAROUND SCHOOLS 
AND COMPARISON SCHOOLS FROM 1978 THROUGH 1981 





Operation 


Turnaround 




Compari son 






Year 


Total 
Teachers 


Number 

Left Percent 


Total 
Teachers 


Number 
Left 




1978 


114 


32 


28 


108 


28 


26 


1979 


110 


41 


37 


116 


27 


23 


1980 


110 


20 


18 


118 


31 


26 


1981 


120 


35 


29 


114 


18 


16 




Total Percent 


28 


Total Percent 


23 
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TABLE 8 



MEAN NUMBER AND PERCENT OF POSITIVE RESPONSES ON SCHOOL MORALE SURVEY \ 
SUBSCALES FOR OPERATION TURNAROUND AND COMPARISON SCHOOLS 



Operation Turnaround Comparison 



Grades 
1-3 


Ntean 

Positive 
Responses 


Percent 

Positive 

Responses 


Grades 
1-3 


Mean 

Positive 
Responses 


Percent 

Positive 

Responses 


Subscale 












School 
Morale 


8. 3 


83 




7.8 


78 


Self 
as 

Learner 


8.8 


88 




8.8 


88 


Total 
n = 188 


17.1 


85.5 


Total 
n=174 


16.6 


83 


Grades 
4-6 


Mean 

Positive 
Responses 


Percent 

Positive 

Responses 


Grades 
4-6 


Mean 

Positive 
Responses 


Percent 

Positive 

Responses 


Subscale 












School 
Morale 


8.3 


83 




7.8 


78 


Instruction 


7.8 


65 




8.7 


72.5 


Physical Plant 5,8 


48.3 




6.3 


52.5 


Se1 f as 
Learner 


7.4 


61.6 




7.6 


63.3 


Total 
n = 188 


17ol 


85.5 


Total 
n = 174 


16.6 


83 
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There are available some scores from this scale from a 1974 sample which 
included Little River and Holmes Elementary Schools. An inspection of 
Table 9 indicates that there ]nas been some increase in positive responses 
in the lower grades but either no change or decline in positive responses 
in the upper grades. 

In an effort to determine whether or not there is any difference in the 
affective influence of teachers in the Operation Turnaround schools, the 
students were given a scale which was taken from a study designed to in- 
crease helping/supportive behaviors in teachers (Valerious, 1977). This is 
the "Who Helps You" scale. The purpose was to determine to what extent the 
students see the" teacher or the principal as somts/ne who would help them in 
various school situations. 

The results of this scale are presented in Table 10. The results were 
divided into Grades 1 to 3 and Grades 4 to 6. Also, a total score was ana- 
lyzed. In looking at the number of situations in which the teacher was 
chosen, it appears that in the lower grades the students in the comparison 
schools picked the teacher to help them significantly more often than the 
Operation Turnaround students. In the upper grades, the reverse was true. 
Over all the grades, the teacher was chosen more often by students in com- 
parison schools, but this 1s probably due to the responses made by students 
in lower grades. The principal was chosen to help more often by students 
in Operation Turnaround schools over all grades and in the total analysis.. 

The assumption underlying the scale is that if the teacher is seen as more 
helpful or supportive, then he or she would have more positive influence on 
student learning. It might be that older children perceive the teacher in 
a more functional manner. The younger students may not be aware of .the 
educational relationship between themselves and the teacher. The salience 
of the principal for the Operation Turnaround students may be a function of 
the special administrative style which Operation Turnaround has attempted 
to foster. 

The final affective scale is related to the program goal of increasing 
pupils' sense of self-determination. The scale, known as the Intellectual 
Achievement Responsibility scale, has been widely used in research 
(Crandall, Katkovsky, & Crandall, 1965). 

The final affective scale is related to the program goal of increasing pu- 
pils' sense of self-determination. The scale, known as the Intellectual 
Achievement Responsibility scale, has been widely used in research (Cran- 
dall, Katkovsky, & Crandall, 1965). 

The scale measures the extent to which an individual accepts personal re- 
sponsibility for both positive and negative consequences. Table 11 con- 
tains the means (number of situations in which the individual would accept 
personal responsibility) of the positive outcomes, negative outcomes, and 
the total of both for Operation Turnaround and comparison schools. The re- 
sults for each school are also presented except that no data was received 
from Holmes Elementary. These scales were only given to the fourth through 
sixth grade students. Although the means were consistently higher for the 
comparison schools, the only significance was for the negative outcomes. 
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.TABiE 9 

COMPARISON OF LITTLE RIVER AND HOLMES ELEMENTARY SCHOOLS ON SCHOOL MORALE 
SURVEY SUBSCALES, PERCENT OF POSITIVE RESPONSES ON 1974 and 1983 ADMINISTRATION 



Little River 


El ementary 


School 


Holmes 


Elementary School 




Grades 
1-3 


1974 


1983 


Grades 
1-3 


1974 


1983 


School 


76.3 


80 




63.3 


83.07 


Moral e 












Self 












as 

Learner 


82,6 


86 




74.0 


84.0 


Grades 
4-5 


1974 


1983 


Grades 
4-6 


1974 


1983 


School 


59.2 


60.0 




52.5 


.. 50.0 


Moral e 












Instriiction 


65.8 


68.3 




59.2 


59.2 


Physical Plant 


70.8 


75.03 




64.2 


63.2 


Sel f as 
Learner 


51.7 


51.7 




53.3 


47.5 


L.„ 













34 



TABLE 10 

MEAN NUMBER OF TIMES STUDENTS CHOSE TEACHER OR PRINCIPAL ON 

"WHO HELPS YOU" SCALE 





Grades 1 


-3 


Grades 4-6 


TOTAL 


Teacher 


Mean | S.D. | 


T 


Mean | S.D. 


T 


Mean | S.D. | 


T 


Operation 
Turnaround 


4.04 2.98 


9.33** 


4.40 2.32 


3.31** 


4.17 2.76 


3.66** 


Compari son 


7.16 2.89 

! 


• 


3„51 2.00 




5.06 3.02 




Principal 


1 ] 




] 




] ] 




Operation 
Turnaround 


2.17 1.27 


4.89** 


2,84 1.25 


2.79** 


2.41 1.30 


3.49** 


Compari son 


1.41 1.45 




2.44 1.34 




2.01 1.50 




** p .01 
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TABLE 11 

MEANS, T-TESTS, ANOVA OF RESPONSES OK STUDENTS ON INTELLECTUAL ACHIEVEMENT 
RESPONSIBILITY SCALE SCORES FOR POSITIVE (POS) SITUATION RESPONSIBILITY, 
NEGATIVE (NEG) SITUATION RESPONSIBILITY, AND TOTAL SCORE. RESULTS OF 

FOLLOW-UP, TUKEY B TEST ARE REPORTED 







Mean S.D. 


T 




n o c 
r Jo 


Operation 
Turnaround 

Compari son 


11.93 
12.38 






NEG 


Operation 
Tu rnaround 

Compari son 


iU. hd 
11. 18 


2.13* 


5.091** 


TOTAL 


Operation 
Turnaround 

Comparison 


22.34 

23.57 




4.55** 


* P 
** p 

c 


.05 
.01 








Tukey 


B 










Orchard Vi 1 la 


Little River 


*** Evans 


Poinciana Park Wheatley* 


POS 


11.56 


13.15 


12.09 


11.96 12.94 


NEG 


10.11 


11.58 


10.50 


11.22 11.81 


TOTAL 


21.68 


24.84 


22.59 


23.18 24.75 




ddtd for Holmes 




♦Underlined means to left of Wheatley are 
significantly different from Wheatley 
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An analysis of variance for the five schools was performed for the posi- 
tive, negative, and total scores and there was a significant outcome for 
each. An inspection of the means of each of the schools in the lower half 
of the table and a follow up test of the ANOVA indicated that these dif- 
ferences were between Phyllis Wheatley and Orchard Villa Elementary schools 
on the positive items, and between Phyllis Wheatley and Orchard Villa and 
L.C. Evans on the negative and the total scores. Here again, school to 
school variation may outweigh any effects of Operation Turnaround in this 
data. 

Summary . On these three measures of student affect, we find very little 
di fference between Operation Turnaround schools and comparison schools. 
What differences there are seem to be in one set of grades and not the 
other, or in one of the schools of one group and one of the schools in the 
other group. There is no consistent indication of any impact on 'student 
affect that would be attributed to Operation Turnaround. 

Principals . 

The principal questionnaire was completed by^.three of the six principals 
Involved in this evaluation. It is not appropriate to make program compar- 
isons as only one principal from the comparison schools responded, however, 
we do note that in general, the responses by the principals are more posi- 
tive than the teachers' responses on comparable questions. 



Student Attendance 

Attendance data were gathered for the second marking period for the Opera- 
tion Turnaround schools and the comparison schools for the years 1977-78 
through 1982-83. That data are presented in Table 12. Attendance at all 
six schools appears to be consistantly high over the years and there do not 
seem to be any differences among the schools. 

Parent and Community Involvement 

Operation Turnaround planners had hoped to increase parent involvement with 
the schools and increase community awareness in an effort to reduce vandal- 
ism and make the school and its surrounding area a safer place to be. In 
an effort to gauge parent involvement a very small sample of parents were 
contacted by this office. Parents were identified through computer list- 
ings of students names and telephone numbers and a short telephone survey 
was conducted. Only 21 parents were actually reached so that even though 
the sample was randomly selected, the number of parents was so low that our 
results may not generalize to the rest of the parents. Our main purpose 
was to ascertain whether parents were aware of Operation Turnaround. We 
found that there was a low awareness regarding any aspect of the school, 
not the least of which was Operation Turnaround. Only a very small number 
had actually heard of the program. Since the sample is small we cannot 
draw any conclusions regarding parent awareness of the program, however, we 
do note that most responses were positive regarding the schools in general. 

Since efforts at raising community involvement had as a goal the reduction 
of vandalism and violence at the schools, records of vandalism and reports 
of violent incidents were surveyed and data were compiled for the Operation 
Turnaround schools and the comparison schools. This data (Table 13) 
indicates that there has been a general decline in vandalism and violent 
incidents at all six schools since 1977-78. Operation Turnaround schools 
seem to have had a sharp decline in total reported incidents in 1981-82 and 
O 1982-83. 
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TABLE 12 



ATTENDANCE FOR OPERATION TURNAROUND AND COMPARISON SCHOOLS FROM 1977-78 THROUGH 1982-83 

PERCENT ATTENDANCE AT SECOND MARKING PERIOD. 



ope.^ation turnaround 








Little 


River 


urchard 


Villa 


Holmes 






K. 


1 - 6 


K 


1 - 6 


K 


1 - 6 


177-78 




83.88 


89.52 


89.60 


92.61 


91.33 


91.21 


178-79 




87.09 


90.19 


88.28 


92.52 


91.63 


91.23 


(79-80 




88.27 


90.90 


90.72 


92.91 


88.84 


91.25 


'80-81 




89.00 


89.85 


86.56 


89.88 


88.46 


90.17 


■81-82 




92.10 


91.69 


93.33 


93.75 


91.50 


92.46 


i82-83 

1 

/ 




93.39 


92.37 


89.51 


92.33 


84.35 


90.23 


C 


OMPARISON SCHOOLS 








Poinclana Park 


Phyl lis 


Wheatley 


Lvans 






K 


1 - 6 


K 


1 - 6 


K 


1 - 6 


77-78 




88.39 


89.06 


87.39 


88.97 


85.27 


89.29 


78-79 




87.72 


88.92 


84.50 


89.09 


87.52 


88.53 


79-80 




88.11 


90.31 


92.94 


91.57 


89.86 


90.04 


80-81 




89.94 


88.77 


88.76 


88»44 


84.71 


89.05 


81-82 




93.21 


' 92.15 


88.49 


92 V 


88.32 


91.54 


82-83 




90.04 


88.42 


88.65 


92.48 


85.20 


91.58 
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TABLE 13 



NUMBER OF REPORTED INCIDENTS OF BREAKING AND ENTERING. VANDALISMS, AND ALL OTHER CATEGORIES 
FOR OPERATION TURNAROUND AND COMPARISON SCHOOLS FROM 1977-78 THROUGH 1982-83 



77 - 78 78 - 79 79 - 80 80 - 81 81 - 82 82 - 83 

















































Breaking 

and 
Entering 




69 






55 






57 






87 






58 






39 




uperati on 
Turnaround 




Vandalism 




41 






51 






48 






18 






18 






10 








Total* 




222 






214 






165 






146 






115 






84 








Mean 




74 






71 






55 






49 






38 






28 


















































Breaking 

and 
Entering 




66 






26 






88 






96 






82 






76 




Comparl son 




Vandal ism 




40 






35 






31 






38 






19 






15 








Total* 




189 






212 






177 






189 






142 






141 








Mean 




63 


a 




70 






59 






63 






47 






47 





*Totdl includes all reported incidents 
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Discussion 



The data presented above, taken as a whole, present an inclusive picture of 
the impact of Operation Turnaround. Although State Student Assessment test 
scores have made continuous improvement, this performance has been paral- 
leled in schools having similar populations and conditions. In addition, 
this improvement began shortly after the onset cf Operation Turnaround 
making us cautious in our interpretation of this recovery. The Stanford 
Achievement test results appear even more equivocal, both in terms of iden- 
tifying the Operation Turnaround schools as more severely deficient than 
other similar schools, and in terms of isolating any dramatic changes in 
the available data subsequent to the beginning of Operation Turnaround. 

The poor pattern of performance of the Operation Turnaround schools and 
comparison schools relative to the national norms appears to continue. The 
scores for any particular grade for any year seem to be lower than that 
grade the previous year. It is possible that this may be a function of the 
cognitive range required on the Stanford and the emphasis on basic skills 
in the schools In question. Continued emphasis in the classroom on a nar- 
rower range of basic skill requirements may be preventing the more capable 
students from reaching the more advanced content areas tested on the Stan- 
ford. In as much as there have only been two years of Stanford administra- 
tion since the inception of Operation Turnaround, it has not been possible 
to examine trends; however, the descriptive data from those tests are not 
encouraging. 

It Is not possible, from the available data, to conclude that Operation 
Turnaround has had any effect on Student performance on either the State 
Student Assessment tests or the Stanford Achievement tests. 

Changes in student achievement were expected to be the result of several 
indirect actions. Physical plant Improvements, optimizing teachers' compe- 
tence through staff changes and in-service training, and closer cooperation 
between teachers, principals, and area and district level administrators 
were the methods which were expected to lead to general improvements in 
these schools. 

In order to distinguish any changes brought about by these approaches, it 
was necessary to look at schools which did not have the advantages proposed 
for Operation Turnaround schools. It was Important to establish some sort 
of comparability for those schools and although it was not possible to find 
exactly equivalent schools, we believe that sufficient criteria were met 
for a fair comparison to be made. Our approach was to examine several 
areas of teacher attitude to determine if we could distinguish any positive 
attitudes regarding the school environment in Operation Turnaround teach- 
ers. The results of comparisons between the two sets of teachers showed 
few significant differences in areas such as student potential, teacher co- 
hesiveness, job satisfaction, or administrative relations. Those differ- 
ences that were found did not tend to be consistent. There are several re- 
servations about the teacher questionnaire data. Since teachers were re- 
quested to submit their names, it is possible that those who did respond 
were less than candid. In addition, the response rate was less than one 
third and it is quite possible that the respondants did not represent the 
population of teacners at these schools. It does seem, however, that those 
teachers who would have been most enthusiastic about Operation Turnaround 
would have responded. It is not clear whether or not that was the case. 
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It is possible that there was some suspicion on the part of the teachers as 
to the nature and motives of this evaluation. This may be a function of 
imposing an evaluation in a post hoc manner from without, rather than mak- 
ing the evaluation process part of the program itself. In any event, the 
pattern of attitudinal data does not establish a clear cut improvement for 
Operation Turnaround teachers as opposed to teachers in other schools. One 
area of the teacher questionnaire which may suggest explanations for this 
is the teachers' perception of the Implementation of Operation Turnaround. 
It is clear that the teachers have not seen the improvements that were pro- 
mised as part of the original plans of Operation Turnaround. It is possi- 
ble that the discrepancy between what teachers expected and what has been 
implemented, in their perceptions, is great enough to have negatively ef- 
fected their attitude towards the program. 

The results reflecting students attitude also do not clearly distinguish 
Operation Turnaround pupils from the pupils in comparable schools. There 
are differences, but these are not consistent so th-it they are not attrib- 
utable to program impact. No measure Indicates any favorable conclusions 
regarding programmatic influence on student attitude. 

What, then, has happened in the Operation Turnaround schools? Operation 
Turnaround began after a three month planning period with staff changes, a 
summer in-service, and a commitment to physical plant upgrading and in- 
crease and upgrading of instructional materials. All this occurred in re- 
sponse to very low State Student Assessment scores, a pattern of declining 
performance on the Stanford Achievement tests and personnel problems, the 
exact nature of which are contained in a confidential report written by the 
DESI. 

Whatever caused the extreme low scores on the State Student Assessment 
tests in 1979-80, had a short-lived effect. The problem of the declining 
Stanford scores have been discussed above and there does not seem to be a 
change in performance pattern on those tests through the present. It is 
possible that the greatest change brought about with Operation Turnaround 
has been in personnel. Given the lack of data regarding the nature of pre- 
vious school staff this report has been unable to examine the qualitative 
change in personnel. Informal conversations with school and district level 
administrators indicate that there were teachers in those schools who did 
not "display an aptitude for teaching." It may be that replacing those 
teachers was the most significant aspect of Operation Turnaround. 

The physical repair of the schools, although necessary and probably long 
overdue, does not appear to have impressed the teachers. The fact that air 
conditioning was promised and still has not been delivered may well have 
overshadowed whatever other physical improvements have been made. Whatever 
has happened at the Operation Turnaround schools, it apparently was not 
enough or not appropriate to the problem. 

Improving schools which have a history of difficulty is a major undertak- 
ing. Literature has been examined from two projects which had the same 
goals as Operation Turnaround, but on a Urger scale. One of these pro- 
jects is the School Improvement Project in New York City and the other is 
Project Rise in Milwaukee. Before describing a few of the features of 
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these programs, it is important to, note that they are not universally ef- 
fective. Although they report improvements, they do not come quickly and 
different schools respond i^ different ways to these programs. Certain as- 
pects of these programs and\ome conclusions they have reached about imple- 
menting school improvement prciqrams deserve consideration. 

The most i.nportant feature of Ejoth programs seems to be the belief that 
schools can make a difference, \Nationally known experts in school effec- 
tiveness were brought in to help both district level staff and school level 
personnel to believe in the possicn 1 i ties for change and to help in the 
initial planning of the projects. Another distinguishing feature of these 
two projects was the time allocated 1:0 and locus of planning. Both pro- 
jects emphasized planning on the schoa\ level and spent over a year in the 
planning stage. Comprehensive needs aissessments and self evaluation were 
carried out at the school level and implementation was not begun until the 
second year. Both programs have found t^hat the degree of commitment and 
the degree of instructional leadership from the principal were the key in- 
gredients in these programs. Other features of these programs were strong 
district support, continual monitoring, and high visibility. 

It appears that some of the«e essential, features were missing in the Opera- 
tion Turnaround project. Insufficient planning on the school level and 
lack of district support has left Operation Turnaround as just a small part 
of these schools' daily concerns. It is just another program along with 
Chapter One and Comprehensive Education and, because it requires less legal 
attention (reporting), probably has less pull on the time of the principal 
and his or her staff. 

In summary , the changes which have occurred at Operation Turnaround schools 
have not been evidenced as statistically significant in this evaluation. 
This is not to say that change has not occurred, but that program impact 
has not been demonstrated by the performance measures or attitudinal mea- 
sures which have been described in this report. In reality, Operation 
Turnaround has been an ambitious program which may still be in its develop- 
mental phase. 




42 



Recommendations 



Since program implementation 1n_j/arious areas has not occurred as 
quickly as the school staff had anticipated and because this per- 
ceived lag may have affected the morale of program staff, it is 
recommended that evaluation be continued aS full implementation 
occurs. 

It is recommended that individual school level comprehensive 
plans, focusing on instructional programming, be developed for 
Operation Turnaround schools. (Examination of the planning pro- 
cess reported by Project Rise and the School Improvement Project 
may be useful here. ) 

It is recommended that school level evaluation and monitoring 
plans be developed in consultation with the Office of Educational 
Accountability. 

It is strongly recommended that parent involvement be increased 
possibly through an outreach program. 
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AVERAGE 



PERCENT MASTERY SCORES FOR THE STATE ASSESSMENT TESTS FOR 1977-78 THROUGH 



1982-83 



SCHOOL 



1 




Holmes El em 
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HOLMES - STANFORD ACHIEVEMENT 



Median Percentile Ranks 



READING 



MATH 

COMPUTATION 



Grade 1 
2 
3 
4 

5 



80 
80 
64 
30 
34 

31 



43 

52 
44 
22 
30 

23 



62 
54 
62 
42 
44 
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7th Edition 
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WHEATLEY - STANFORD ACHIEVEMENT 



Median Percentile Ranks 
6th Edition 
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1978 
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64 
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27 
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31 
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comparable to the 6th Edition 
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POINGIANA PARK - STANFORD ACHIEVEMENT 
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Grade 1 
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EVANS - STANFORD ACHIEVEMENT 



Median Percentile Ranks 



READING 



MATH 

COMPUTATION 



Grade 1 
2 
3 
4 
5 
6 



50 
54 
58 
34 
36 
30 



16 
40 
36 
34 
30 
40 



34 
50 
44 
42 
38 
30 







6th 


Edition 






1977 


1978 


1979 


1980 


1 


36 


31 


34 


37 


2 


26 


14 


22 


52 


3 


23 


26 


23 


27 


4 


16 


22 


34 


38 


5 


23 


20 


27 


32 


6 


10 


81 


18 


26 



7th Edition 



50 
58 
44 
48 
38 
32 



1981-82 
39 
19 
14 
15 
18 
7 



40 
45 

27 
33 
29 

26 



CHART/ 1st Gr. - 6th Gr. 
LEVI FT: nn 

8/8/83 53 

o 63 

ERIC 



COUNTY - STANFORD ACHIEVEMENT 
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Grade 1 
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62 
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READING 



MATH 

COMPUTATION 



Grade 1 
2 
3 
4 
6 
6 



ORCHARD VILLA - STANFORD ACHIEVEMENT 
Median Percentile Ranks 
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DADE COUMTY PUBLIC SCHOOLS 



DR. LEONARD M, BRITTON 
SUPERlNTENOaNT OF SCHOOLS 



OFFICE OF EDUCATIONAL ACCOUNTABILITY 
1410 NORTHEAST SECOND AVENUE 
MIAMI. FLORIDA 33132 



DADE COUNTY SCHOOL BOARD 
Mil. G. HOLMES BRADDOCK, CHAIRMAN 
MHS. ETHEL BECKHAM, VICE-CHAIRMAN 



DR. RAY TURNER 
ASSISTANT SUPEHINTENDENT 
EDUCATIONAL ACCOUNTABILITY 
<305) 330-3447 



June 9, 1983 



M«. PAUL L. CPJAS 
DR. MICHAEL KRO? 
MS. JANET MCALILEV 
MR, ROBERT RENICK 



MR. WILLIAM H. TURtvER 



Dear Teocher, 

At a recent meeting, you received a questionnaire which was designed 
to examine teachers' perceptions of themselves, their students, and 
their work environment as part of an evaluation of Operation Turnaround. 
We are communicating with you at thil time to thank all of you who have 
already turned in the questionnaire for your efforts. We would also 
like to encourage those of you who have not completed your questionnaire 
to do so. , 

We vvant to assure you that the data from this survey will be treated con- 
fidentially. Ue are requesting your name only to allow ourselves the 
possibility of follow-up and to identify your school. 

If, in spite of our assurance, you are still uncoi:ifortabl e with identi- 
fying yourself, please just .put the name of your school on the question- 
naire instead of your name. Your participation in this study is needc<! 
and appreciated. If you have questions about this specific request, or^ 
the evaluation in general, uiOdSC- do not hesitate to call me at 350-3'";-/. 



S i r<rorr- 1 v , 



DADE COUNTY PUBLIC SCHOOLS 
OFFICE OF EDUCATIONAL ACCOUNTABILITY 



OPERATION TURNAROUND 
RESPONSE ITEMS - TEACHER QUESTIONNAIRE 



Dear Teacher; 



This questionnaire is part of an attempt to develop an overall understand 
ing of the Operation Turnaround project both In terms of the Operation Turn- 
around schools and in relation to several other schools. In order to accom- 
plish this we are investigating several aspects of school organization. 
One of these areas is the teachers' perspective in terms of their own atti- 
tudes, impressions, and feelings regarding themselves, their jobs, the 
children, and the school climate. 

The following information is requested for research purposes only. Specific 
responses will not be attributed to any individual. We are requesting your 
name so that you can be contacted in the event that you are selected as part 
of a small sample for follow-up interview. 

Please return the completed questionnaire via school mall in the attached 
envelope to: Dr. Jerome Levitt, Board Adra. Building, Mail Code 9999, Rm. 800 
by June 3, 1983o Should you have any questions about this survey, please 
call me at 350-3447. 

Sincerely, 

Dr. Jerome Levitt 
Evaluation Specialist 



Opera. Compar 
Turnar, 



Name 
Sex 

AcjG 



Mai e 



Fema 1 e 



Race (cneck crie-) 



White, non Hispanic 
Bl ac< , non H i 'ijjan i c 
Hi span i c 

h', 1 an Pjc i ^ 1 c I s 1 andnr 



8 33 6 2 
7 = 39 43 
SD- 10.21 10.9 
23 11 



13 
3 



12 
9 



id- 



) r . i 



; « . J • ; ' { . 



6.1 5.6 
5.5 

! 1 . 1 M . 7 
8.6 
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SECTION I 



1. 



This section of the questionnaire concerns children in your classes. Indi- 
cate the extent to which the following phrases characterize your students by 
circling the appropriate number after each phrase. 



1 


2 


3 


4 


5 


Very Much 










Unl ike My 








Very Much Like 


Students 








My Students 



1. 

2. 
3. 
4. 
5. 
6. 
7. 



like being at school 
can acqui re basic ski 1 Is 
complete their classv^ork 
enjoy physical education 
wi 1 1 get promoted 



1 
1 
1 
1 
1 



have been doing better over the last few years 1 
know how to behave in the classroom 1 



2 
2 
2 
2 
2 
2 
2 



3 
3 
3 
3 
3 
3 
3 



4 
4 
4 
4 
4 
4 
4 



5 
5 
5 
5 
5 
5 
5 



Opera. Compat 
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What percent of your students do you think will finish high school? (check 
one) 



under 10% 



ll%-24% 



25%-50% 



51%-75% 



76%-lOOrc 



1 2 3 4 5 

What percent of your students do you think might attend college? (check one) 



under 10% 



ll%-24% 



25%- 50% 



51%-75% 



76%- 100% 



1 



2 



3 



Do you have any special relationships with any of the children in your 
class, (i.e., Do they come to you if they are troubled?) (check one) 

yes no 



1 



Oo you have contact with parents? 



1 



yes no 

2 



What percent of your school's parents have you seen or talked to since 
school began last September 1982? (check one) 



under 10% 



11%- 24^'. 



25X-5C% 



51^-7 5X 



76% -100% 



1 ^345 

How iid.'iy ti'Hos .i yi^ar do you speak to inost parent's''' (check one) 



Means 

4.07 ^.'47 
3.76 ^ 3.38 

3.74 3.45 

4.51 4.35 

4.15 3.88 

3. 54 3.33 

3.29 3. 12 



3. 79 3.44 



2.17 2.32 

Number 

1 a 1 

37 5 33 

40 1 32 ■' 
Means 

3.59 ?.?; 



oru..t-> .-I y'.'.tr two t iirips a y^^dr 



three times foi;^ times 

y- 

f i vf? or iiof'f' t imps 



1 1 



\? 3.0' 
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Teacher Questionnaire (continued) 2. 

Have you met more than one adult in most of your school's families? (check 
one) 



yes 



no 



Do you know the names of the siblings of most of your students (if they 
have any)? (check one) 

yes no 

1 2 



Opera. Compar 
Turnar , 

Number 

T T Y N 
15 26 16 1 



18 22 13 2 
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Teacher Questionnaire (continued) 



3. 



SECTION 11 

This section of the questionnaire is a general opinion survey which Is de- 
signed to find out the way In which certain Important events In our society 
affect different people. Each item consists of a pair o* alternatives/ let- 
tered £ or b^. Please select the one statement of each pair (and only* one) 
which you more strongly believe to be the case as far as you're concerned. 
Be sure to select the one you actually believe to be more true rather than 
the one you think you should choose or the one you would like to be true. 
This Is a measure of personal belief; obviously there are no right or wrong 
answers. 

You answer, either £ or b to each question on this inventory, is to be 
checked (X) to the left ofthe selected alternative. 

Please answer these Items carefully but do not spend too much time on any 
one Item. Be sure to find an answer for every choice, For each numbered 
question make an X on the line beside either the £ or b, whichever you 
choose as the statement most true. " 

In some Instances you may discover that you believe both statements or nei- 
ther one. In such cases, be sure to select the one you more strongly be- 
lieve to be the case as far as you're concerned. Also try to respond to 
each Item independently when making your choice; do not be Influenced by 
your previous choices. 

Remember. 

Select that alternative which you personally believe to be more true. 



(over) 



Teacher Questionnaire (continued) 4, 
I more strongly believe that: 

1. a. Children get Into more trouble because their parents punish 

them too much. 

b. The trouble with most children nowadays is that their parents 
are too easy with them. 

2. ' ^ a. Many of the unhappy things in people's lives are partly due 

to bad luck. 

b. People's misfortunes result from the mistakes they make. 



3. 



a. One of the major reasons why we have wars is because people 
don't take enough Interest in politics. 

b. There will always be wars, no matter how hard people try to 
prevent them. 



4. a. In the long run people get the respect they deserve in this 

~ world. 

_____ b. Unfortunately, an individual's worth often passes unrecogniz^ 
ed no matter ^ow hard he tries. 



5. a. The idea that teachers are unfair to students is nonsense. 

b. Most students don't realize the extent to which their grades 
- are Influenced by accidental happenings. 

6. a. Witnout the right breaks one cannot be an effective leader. 

b Capable people who fail to become leaders have not taken ad- 
vantage of their opportunities. 

7. _ „ ^. -No matter how hard you try, some people just don't like you. 

b. People who can't get others to like them don't understand 
how to get along with others. 

H. a. Heredity plays the major role in det -inining one's personal- 

ity. 

h. [r is onp's exppfieni.^ in life which fjHr»r;nines what they're 



Opera. Compar 
Turnar . 

Mean External 



Score 



7.71 7.88 
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Teacher Questionnaire (continued) 5. 
I more strongly believe that: 

9. a. I have often found that what is going to happen will happen. 

b. Trusting to fate has never turned out as well for me a? mak- 
ing a decision to take a definite course of action. 



10. 



11. 



12. 



13. 



14, 



a. In the case of the well -prepared student there is rarely, if 
ever, such a thing as an unfair test. 

b. Many times exam questions tend to be so unrelated to course 
work that studying is really useless. 



a. Becoming a success is a matter of hard work, luck has little 
or nothing to do with it. 

b. Getting a good job depends mainly on being in the right place 
at the right time. 



a. The average citizen can have an influence in government deci 
sions, 

b. This world is run by the few people in power, and there is 
not much the little guy can do about it. 



a. When I make plans, I am almost certain that I can make them 
work . 

b. It is not always wis^^ to plan too far ahead because many 
things turn out to he a matter of good or bad fortune anyhow 



a. There are certain people who are just no good. 

b. There is some good in everybody. 



Opera. Compar 
Turnar. 



a. In my case getting what 1 want has "little or nothing to do 
with luck. 

b Many times we may just as well decide whot to do by flipping 
a coin. 



if), .-i . Who gets to be the boss often depends on wh'i wc3S lucky enough 

to be in the right place first. 

;:. '">f'^.fing peopif^ to do the right thing (jepf3n;1s upon ability; 
!ias little ;);■■ notniny to do with it. 

(ove r ) 



er|c 7i 



Teacher Questionnaire (continued) 6. 
I more strongly believe that: 

17. a. As far as world affairs are concerned, most of us are the 

victims of forces we can neither understand nor control. 

b. By taking an active part in political and social affairs, the 

people can control world events. 

18. a. Most people can't realize the extent to which their lives are 

controlled by accidental happenings. 

b. There is really no such thing as luck. 

19. _____ a. One should always be willing to admit his mistakes. 
b. It is usually best to cover up one's mistakes. 

20. __a. It is hard to know whether or not a person really likes you. 

b. How many friends you have depends upon how nice a person you 

are. 



21. _a. In the long run the bad things that happen to us are y 

balanced by the good ones. 

b. Most misfortunes are the result of lack of ability, 

ignorance, laziness, or all three. 

22. a. With enough effort we can wipe out political corruption. 

b. It is difficult for people to have much control over the 

things politicians do in office. 



23. 



24, 



a. Sometimes I can't understand how teachers arrive at the grade 
they give. 

b. There is a direct connection between how hard I study and the 
grades I get. 



a. A good leader expects people to decide for themselves what 
they should do. 

b A good leader makes it clear to everybody whdt their jobs 
are. 



Opera. Compar . 
Turnar. 
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Teacher Questionnaire (continued) 
I more strongly believe that; 



7. 



25. 



26. 



27. 



28. 



29. 



a. Many times I feel that I have little influence over the 
things that happen to me. 

b. It is impossible for me to believe that chance or luck plays 
an important role in my life. 

a. People are lonely because they don't try to be friendly. 

b. There's not much use in trying hard to please people. If 
they like you, they like you. 



a. There is not too much emphasis on athletics in high school. 
bo Team sports are an excellent way to build character. 



a. What happens to me is my own doing. 

b. Sometimes I feel that I don't have enough control- over the 
direction my life is taking. 



a. Most of the time I can't understand why politicians behave 
the way they do. 

b. In the long run the people are responsible for bad government 
on a national as well as on a local level. 



Opera. Compar . 
Turnar. 
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Teacher Questionnaire (continued) 

SECTION III The next set of questions concern the school environment. 

A. How many teachers in this school do you socialize with? (check one) 
0 1-3 4-5 6-10 11 or more 



8. 



B. 



C. 



D. 



b. 



1 2 3 4 5 

If you needed help or advice concerning some problem you were having in 
your class, how many other teachers would you consider going to? (check 
one) 



0 



1 - 3 



6 - 10 



11 or more 



To what extent do you feel that teachers in your school support each 
other? (check the appropriate number in the scale below) 



Very Much 
1 



Not Very Much 



Please list by first name or initial, the people in each of the cate- 
gories below who are important to you and to whom you are important in 
your school. Then indicate (1) their importance to you and (2) how 
important you feel you are to them. 



Important to you 



other teachers 



Very 
1 



Not Very 
Important 
1—^^ 



2 
2 

2 



3 
3 

3 



4 
4 
4 



adini n i ■st rators 



2 3 4 5 
2 3 4 6 
? 3 4 S 



other school personnel 
(Enter role: cl erk , 
psycho logi st , etc. ) 



How Important You to Them: 



Very 






Not Very 
Important 




2 


3 


4 5 


1 


2 


3 


4 5 


1 


2 


3 


4 5 


1 


2 


3 


4 5 


I 


2 




4 b 


1 


■) 


.J 


4 S 


I 


? 


] 


4 ^ 



! 1 



Opera, Compar 
Turnar, 



Means 



3.38 3.56 



2.76 2.68 



3.45 2.29 



Mean 

Combination o 
A, B, C 

2.91 3.33 

The following 
items (a, b, 
c, 1-14) were 
compressed* t 
3 scores , rep 
resenti ng 

1) Other 
teachers 

1.57 1.67 

2) Administra 
tors 

2.50 1.86 

3) Other 
School 
Personnel 

1.88 



* ! 1 It ems 
■M^f'' adjusted 
^ :) the same 



Teacher Questionnaire (continued) 9. 

Fop each of the three categories on the previous page , circle the person 
who Is most linportant to you. Then for each of these persons, answer the 
following questions by circling the appropriate number in the scale to the 
right. 



1. 



2. 



3. 



4. 



ERIC 



Does this person know important people in your profession? 
All 



None 



68 



co-worker 


(1) 


(2) 


(3) 


(4) 


(5) 


supervi sor 


(1) 


(2) 


(3) 


(4) 


(5) 


professional 


(1) 


(2) 


(3) 


(4) 


(5) 


How often are you in touch with 


(see, talk, 


write) this 


person? 








Few 




Few 








Times 




Times 




Daily 


Weekly 


a Month Monthly 


a Year 


co-worker 


(5) 


(4) 


(3) 


(2) 


(1) 


supervi sor 


(5) 


(4) 


(3) 


(2) 


(1) 


professional 


(5) 


(4) 


(3) 


(2) 


(1) 


To what extent does this 


person 


make you feel liked? 






A Lot 








A Little 


co-worker 


(1) 


(2) 


(3) 


(4) 


(5) 


supervi sor 


(1) 


(2) 


(3) 


(4) 


(5) 


professional 


(1) 


(2) 


(3) 


(4) 


(5) 


Who usually 


takes the initiative 


to get in 


touch? 














Al ways 




Always Me 








Him/Her 


co-worker 


(1) 


(2) 


(3) 


(4) 


(5) 


supervi sor 


(i) 


(2) 


(3) 


(4) 


(5) 


pro tes"^ 1 OHd 1 


(1) 


(2) 


(3) 




(5) 


How '.;;oS^• -lo 


you Tee 1 to 


this pe 


rson ? 
















Not Close 




Verj^ Close 








at All 


. .v-w . .•r 


' ! ^ 


/ ■) \ 




' t ^ 
■ 4 ! 








/ •« 


\ ■ ■ J 


1 ! 


[\] 


; . f ! f . ■ . . ^ • • • 1 ' 




/ ) \ 


1 i) 


1 





Opera. Compar . 
Turnar. 



Teacher Questionnaire (continued) 

6. How close do you think this person feels to you? 



7. 



9. 



10. 



co-worker 
supervi sor 
professional 



Very Close 

(1) (2) 

(1) (2) 

(1) (2) 



10. 



Not dose 
at All 



(3) 
(3) 
(3) 



(4) 
(4) 
(4) 



(5) 
(5) 

(5) 



Does this person reassure you when you are feeling uncertain about 
something? 



co-worker 
supervi sor 
professi onal 



A Lot 

(1) 
(1) 
(1) 



(2) 
(2) 
(2) 



(3) 
(3) 
(3) 



(4) 
(4) 
(4) 



A Little 
(5) 

(5) ■ 
(.5) 



8. Do you talk to this person when you are upset, nervous, or depressed? 



co-worker 
supervi sor 
professional 



A Lot 

(1) 
(1) 
(1) 



(2) 
(2) 
(2) 



(3) 
(3) 
(3) 



(4) 
(4) 
(4) 



Do you confide in this person? 
A Lot 



co-worker 
supervi sor 
professiond 1 



(1) 
(1) 
(1) 



(2) 
(2) 
(2) 



(3) 

(3) 
(3) 



(4) 
(4) 

(4) 



Does this person approve of the way you do things? 
A Lot 



co-worker 
supervi sor 



(1) 
(I) 
(1) 



(2) 
(?) 
(2) 



(3) 
(3) 
(3) 



(4) 
(4) 



A Little 

(5) 
(5) 

(5) ■ 

A Little 
(5) 
(5) 
(5) 

A Little 
(5) 

(5) 
(5) 



Opera. Compar . 
Turnar. 



over 
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Teacher Questionnaire (continued) 
11. Does this person give you advice? 

AJj)t 

co-worker (1) (2) 
supervisor (1) (2) 
professional (1) (2) 



(3) 
(3) 
(3) 



12. Does this person make «?ou feel respected? 

A Lot 

co-worker (1) (2) (3) 

supervisor (1) (2) (3) 

professional (1) (2) (3) 

13. Does this person see things the way you do? 

A Lot 

(2) (3) 

(2) (3) 

(2) (3) 



co-worker 



(1) 

supervisor (1) 
professional (1) 
14. Would this person lend you money? 

A Lot 

(2) 
(2) 
(2) 



co-worker 



(1) 

supervisor (1) 
professional (1) 



(3) 
(3) 
(3) 



(4). 
(4) 
(4)' 



(4) 
(4) 
(4) 



(4) 
(4) 
(4) 



(4) 
(4) 
(4) 



11. 

A Little 
(5) 

(5) . 
(5) 

A Little 
(5) 
(5) 
(5) 

A Little 
(5) 
(5) 
(5) 

A Little 

(5) 
(5) 
(5) 



Opera. Compar 
Turnar . 



ERIC 
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Teacher Questionnaire (continued) 
SECTION IV 



12. 



Of the three student qualities listed below, check the one which you think 
each of the following people would rate as most important. 





Students 
As People 
(1) 


Students 
Learni ng 
(2) 


Students Being 
WelUBehaved 
(3) 


a. Most of the administrators 
in your school : 


No. % 

T~ 978 


No. f % 
■?r 1 56.1 


No. % 

Vr 3471 


8 24.2 


..At' 54.5 


7 21.2 


b. Most of the teachers in 
your school : 


3 7.1 


20 47.6 


19 45.2 


2 6.5 


16 51.6 


13 41.9 


c. The teacher you feel 
cl osest to in school : 


13 31.7 


21 51.2 


7 17.1 


6 19.4 


16 51.6 


9 29.0 


d. You yoursel f : 


17 42.5 


22 55.0 


1 2.5 


8 25.8 


21 67.7 


2 6.5 



Opera. Compar 
Turnar. 



Op. T, 

Comp, 

Op. T. 

Comp. 
Op. T. 
Comp. 
Op. T. 
Comp, 



On this scale rate your overall level of self-evaluation or self-esteem onj 
the job; that is, how high or low you presently evaluate your total picture 
of yourself on your job by circling the appropriate number In the scale be- 
low. 

Hi gh Low 



(1) 



(2) 



(3) 



(4) 



(5) 



1.79 1.58 




/ i 



/ 



Teacher Questionnaire (continued) 
SECTION V 



13. 



SAT ;SFACTI ON/D ISS AT I SFACT ION SCALE 



1 2 3^4 5 

provides 

a source of a source of neither a source of a source of 

major moderate satisfaction nrSderate major 

dlssatisfac- dissatlsfac*. nor dissat- satisfaction satisfaction 
tlon tlon Isfactlon 

Please review the fol lowing list of factors which define jrour profession- 
al working environment. Indicate the extent to which each Is a source of 
satisfaction or dissatisfaction, by selecting the appropriate rating from 
the scale above and placing It to the right of the Individual Item. 

my salary _ 

my chances for professional advancement 

opportunities for professional develof»nent 

(through In-service, etc.) _ 

my relationship with parents 

my relationship with school-level administrators 

my relationship with area/(iounty level administrators 

the facilities in which I teach (physical condition) _ 
the rnaterials which I am given or have available tn inp 

the design of the curricula that I am encouraged lo ^jse _ 
the respect shown -ne by 'ny students 

the extent to which the educ.U, i oria 1 -^xper 1 poci^ sco-n^ to c'anTP s t jdf'ft- ^ ' 
behdvior 

the rel»^V'3nce wh,j'. i bf^m; t'lijqht to- "r-'j^ ^Of M ' rt--; li '-.-(-..m^ % 
the Sijp[JOrt fvr'*i/'»'l by nt* fr.-ji'i .vl->' ni -.f r-i^f- i , or (;t.fi*'r i -^-s; ''iti^ ' •■ • 
behdvior 

my pt-»r-,.i'M ' * ^ 



Opera. Compar 
Turnar. 



Means 



2.79 3.09 
3.12 3.58 



3.90 
3.76 
3.50 
3.04 
2.17 
2.68 
2.81 
3.-^1 



3.75 

4.06 

4.30* 

3.48* 

2.55 

2.94 

3.00 

3.79 



3. 
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Teacher Questionnaire (continued^ 
Please answer the following qye$«..jns. 

1. Have there been Instances In which your Principal or Assistant 
Principal has given some kind of specific assistance to you? 
(check one) 

yes no 



14. 



2. 



3. 



4, 



6, 



How many times in the last year would you say you have received 
specific assistance from your principal or assistant principal? 
(check one) 



1 - 3 



4 - 5 



6-10 



11+ 



I 2 4 

Do you feel your principal will "go to bat" for you? 

with parents (check one) yes 

with district (check one) 



yes 



2 

T 



no 
no 



To what extent do you feel that your performance evaluations accurately 
reflect your teaching performance ? (Circle the appropriate number.) 



Not 

Very 

Much 



Very 
Much 



1 2 3 4 5 

To what extent do you feel that your performance evaluations accurately 
reflect your teaching abil ity ? 



Not 

Very 

Much 

1 



2 



4 



Very 
Much 

5 



lO whan ^^x-t.-?nt have you felt thdt you could make improvements In 
r"',i:or!^.<' ♦"') you"" ^eva 1 iat i on-^, (if applicable^? 



•» i: 



Not 

Very 

Much 



r /s'if .;rini. 



Not 

v't'f V 



Vf^ry 
Much 



Opera. Cowipar 
Turnar. 



36 6 



Y 

36 
29 



N 

6 
9 



1 £ 

32 1 



2.74 3.24* 



I 
32 

31 



0 
0 



4.05 4.18 



3. HI 3.94 



3.04 
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Teacher Questionnaire (continued) 15. 
Please answer the following questions. 

8. Does your principal make informed suggestions regarding instruction- 
al methods? 



Not 

At 

All 



Very 
Often 



9. 



1 2 3 4 5 

Is your principal supportive of in-service training efforts? 



Not 

Supportive 
1 2 



Very 

Supportive 



Opera. Compar 
Turna. 



3.15 4.21* 



4.29 4,67* 



1 F V I r T . 4 . r; ' 1 
ACH '•..■■) 



* ; 1 jri i f icant 
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Teacher Questionnaire (continued) 16. 
SECTION VI 

These questions concern Operation Turnaround . ^ 

A. To what extent were you nade aware of the Iraprovenents in your school 
that iiere to occur as a part of Operation Turnaround. (Check one.) 

1, I was fully informed of all planned improvements related to Opera- 
tion Turnaround. 

2. I was given a general idea of the improvements to be made. 

3. Most of the information I had about Operation Turnaround was ru- 

*■ mor . 

4. I was not informed at all about the improvements planned for Oper- 

ation Turnaround schools. 



B. 



For each item listed below please Indicate the degree to which you be- 
lieve It was Implemented in your school as originally planned. Also 
indicate the degree of positive Impact which you think the item has had 
on the overall functioning of your school. 



DEGREE 
IMPLEMENTED 





Not Completely 
Implemented Implemented 


None 








Very 
Much 


New oooks 


(I) 


(2) 


(3) 


(4) 


(5) 


(1) 


(2) 


(3) 


(4) 


(5) 


Parental i nvol vement 


{!) 


(2) 


(3) 


(4) 


(5) 


(U 


(2) 


(3) 


(4) 


(5) 


Media material 


{!) 


(2) 


(3) 


(4) 


(5) 


(I) 


(2) 


(3) 


(4) 


(5) 


New equipment 


(1) 


(2) 


(3) 


(4) 


(5) 


(I) 


(2) 


(3) 


(4) 


(5) 


Bui Idiny rppai 


(n 


(2) 


(3) 


(4) 


(S) 


(1) 


(2) 


(3) 


(4) 


(5) 


E lectri'jd 1 '"eU'i i ^ s 




'?) 


(3) 


(^) 


(5) 


(1) 


(?) 


(3) 


:4) 


(5) 


A1 conip *: ^ on : 


/ \ ) 






''^) 


i 


(1 ) 


i?\ 

» • / 


(3) 


'4) 


(">) 


Paint i'v.) 






; n 


(1) 




(1) 


t •\ \ 
\ ^ i 


(3) 




(S) 




' ^ ) 




n 


■; ^ 1 


'■ ^ 




' ? ^ 


'3; 


'. ^ ''■ 


(b) 




i • 




•■ 


■: 1 ) 


; \ 
• 1 . 


i • ' ■ 




' 1 







POSITIVE 
IMPACT 



Opera* Compar 
Turnar. 
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Opera ♦ Compar 
Turnap. 



C. Indicate the adequacy of each of the Inser/lce aspects listed below by 
circling the appropriate number to the right of each aspect. 

More Than 



Not Enough Adequate 



Frequency 


(1) 


(2) 


(3) 


(4) 


(5) 


Relevancy 


(1) 


(2) 


(3) 


(4) 


(5) 


Task oriented 


(1) 


(2) 


(3) 


(4) 


(5) 


Fol low-up 


(I) 


(2) 


(3) 


(4) 


(5) 



hi 
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Dear Teacher: 

As we discussed W^r meeting, the Office of Educational Accountability has 
been given the reswslblllty of evaluating Operation Turnaround. This 
evaluation requires jL/sample of teachers (of which you are one) to adminis- 
ter two or three (depending on the grade level) short surveys to your stu- 
dents. You do not have to administer all surveys at the same time; but we 
would appreciate it if you could finish the last survey In time to return 
tha completed forms to us by June 10, usinjg the attached envelope. Please 
review the following Instructions for each survey. 

Part I - Who Helps You 

The purpose of this survey Is to Identify the number and kinds of people to 
whom students go for various kinds of help. Please have students fill out 
the Identifying Information at the top of this form (school and grade lev- 
el), and read the Instructions which we have attached to the test packet. 
Additionally, please read each item to your students If you feel that that 
is more appropriate than having them read the items themselves. 

Part II - Intellectual Achievement Responsibility Questionnaire 

(for grades four through six only ) 

The purpose of this survey is to look at students' sense of responsibnity 
for academic and personal success. Please fill out, or have the students 
fill out, the Identifying information at the top of this form (school and 
grade level), and have students select either (a) or (b) for each item by 
placing an X on the appropriate line. 

Part III - Dade County Public Schools School Morale Attitude Survey 

(Primary or Elementary Forms) 

Pr imary (grades i-3): 

After bubbling in school and grade data on the answer sheet, with a #2 pen- 
cil, rpad the examples (a-c) to your students, illustrating how they are to 
select the appropriate responses by darkening the nose of the happy (yes) or 
sad (no) face (also with a #2 pencil), to indicate agreement or disagreement 
with the statement. Then read each of the items to your students allowing 
sufficient time to finish each item bt>fore continuing to the next. Please 
nor«> thnt thf survey is continut'd on the reverse sidf! of the sheet. 



operation Turnaround (continued) 2. 
Elementary (grades 4-6): 

After having students bubble in school and grade data on their answer 
sheets, read the directions to the students and then have them respond to 
each Item using a #2 pencil to bubble in their answers. Questions 1-24 are 
In the front, and questions 25-48 are In the back. Please point this out to 
the students. 



Remember, It is not necesary for all the forms to be completed by the stu- 
dents at one time. However, we would appreciate their completion by June 
10, as mentioned above. 

If you have any questions or concerns, please contact me at 350-3447. 
Sincerely, , 




Ttachtr Instructions for Part I 



Ploaso read thtso Instructions to the students: 

These questions ask you to decide which of the people at the top would help 
you In the situation described below* Just write the number of the person 
on the line near the sentence* 

For exanple: 

The first question asks •Who helps you— when you need help In a school sub- 
ject?*. Look at the list of people at the top and write the number of the 
person whom you think would help ^ with a school subject on the line near 
that sentence* 
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DADE COUNTY PUBLIC SCHOOLS 
OFFICE OF EDUCATIONAL ACCOUNTABILITY 
OPERATION TURNAROUND 
STUDENT QUESTIONNAIRE 
PART I 



School 
Grade 



WHO HELPS YOU? 

1. Student friend 

2. Parent 

3. Relative 

4. Adult friend 

5. School clerk 

6. Classroom teacher 



7. Adjustment teacher 

8. Special Help teacher 

9. Teacher Aide 

10. Principal 

11. Gym teacher/librarian 



1. 


When 


2. 


When 


3. 


When 


4. 


When 


5. 


When 


6. 


When 


7. 


When 


8. 


When 


9, 


When 


in. 


When 


11. 


When 


12. 


When 


13. 


When 


14. 


Whpn 


COMMFNTS: 



you need help In a school subject? 

someone "messes" with you at lunch or on the playground? 

you have a complaint about our school? 

you don't have pencils, pens, paper? 

you have too much homework? 

a person wants to fight you after school? 

you are yelled at unjustly? 

you lose your temper in the classroom? 

someone cyses you? 

you want to be of service to the class or school? 

you have a school problem? 

you are injured at school? 

all school work is too e-isy or too hard'-' 

somt'one takes an itf?m from your deSK. ? 



DO NOT 
WRITE IN 
THIS ' 
COLUMN 

1 - 4 
5-6 



7 
8 
9 
10 

11 
12 
13 
14 

15 
16 
17 

19 
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12. 



13. 



14. 



15. 



16. 



17. 



18. 



19. 



20. 



c 1 . 



Suppose you study to become a teacher* scientist, or doctor and you 
fail. Do you think this would happen 

(a) because you didn't work hard enough, or 
— (b) because you needed some help and other people didn't give it to 
you? 

When you learn something quickly In school. Is It usually 

(a) because you paid close attention, or 

(b) because the teacher explained It clearly? 

If a teacher says to you, "Your work Is fine," Is It 

(a) something teachers usually say to encourage pupils, or 

(b) because you did a good job? 

When you find it hard to work arithmetic or math problems at school, is 

(a) Because you didn't study weP enough before you tried them, or 

(b) because the teacher gave problems that were too hard? 

When you forget something you heard in class, is it 

(a) because the teacher didn't explain it very well, or 

(b) you didn't try very hard to remember? 

Suppose you weren't sure about the answer to a question your teacher 
asked you, but your answer turned out to be right. Is it likely to 
happen 

(a) because she wasn't as particular as usual, or 
^ (b) because you gave the best answer you could think of? 

When you read a story and remember most of it, is it usually 

(a) because you were interested in the story, or 

(b) because the story was well written? 

If your parents tell you you're acting silly and not thinking clearly, 
Is it more 1 i kely to be 

(a) because of something you did, or 

(b) because they happen to be feeling cranky? 

When you don't do well on a test at school, is it 

(a) because the test was especially hard, or 
^ (b) because you didn't study for it? 

When you win at a game of cards or checkers, does it happen 

(d) because you play real well, or 
~ (b) because the other pers )n doesn't play well? 

If people think you're bright or clever, is it 

(a) because they happen to like you, or 

'b; because you usually act that way? 



31 



32 



33 



34 



35 



36 



37 



38 



39 



40 



41 



•} re-icher -.iLin't pass you to the next iride, wo;;' ? 

•'a - because she "had in for you", or 

'D' bo'.:auS(^ yo-jr "iC^ool worV. wasn't loo'l e".Mj-;t:;' 



-.v, -,»> ,.■••»•*■:'■:/ "t)* •■•'.'•"•1 -l!' 5 



ERIC 



OAOE COUNTY PUBLIC SCHOOLS 
OFFICE OF EDUCATIONAL ACCOUNTABILITY 
OPERATION TURNAROUND 
STUDENT QUESTIONNAIRE 
PART II 

School — 

6rad€ 

Put « check ntxt to the phrase that you most believe, either (a) or (b). 
There are no right or wrong ansi^ers. 

1. If a teacher passes you to the next grade, would It probably be 
(a) because she liked you, or 
3 (b) because of the work you did? 

2« When you do well on a test at school. Is It more likely to be 
(a) because you studied for It, or 
3^ (b) because the test was especially easy? 

3, When you have trouble understanding something In school. Is It usually 

(a) because the teacher didn't explain It clearly, or 

(b) because you didn't listen carefully? 

4, When you read a story and can't ren»einber much of It. is it usually 

(a) because the story wasn't well written , or 
^ (b) because you weren't Interested In the story? 

$• Suppose your parents say you are doing well In school. Is it likely to 
happen 

(a) because your school work Is good, or 
^ (b) because they are In a good mood? 

6. Suppose you did better than usual in a subject at school. Would it 
probably happen 

(a) because you tried harder, or 
^ (b) because someone helped you? 

7. When you lose at a game of cards or checkers, does it usually happen 

(a) because the other player is good at the game, or 
^ (b) because you don't play well? 

8. Suppose a person doesn't think you are very bright or clever. 

(a) Can you make him change his mind if you try to, or 

— (b) are there some people who will think you're not very bright no 

matter what you do? 

9. If you solve a puzzle quickly, is it 

(a) because it wasn't a very hard puzzle, or 

(b) because you worked on it carefully? 

10. If a boy or girl tells you that you are dumb, is it ncre likely that 
they say that 

(a) because they are mad at you, or 

— (h) because what you did really wasn't very bright? 
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24. If a boy op girl tells you that you are bright, Is It usually 

(a) because you thought up a good Idea, or ^ 

(b) because they like you? 

25. Suppose you became a famous teacher, scientist or doctor. Do you think 
this would happen 

(a) because other people helped you when you needed It. or 

(b) because you worked hard? 

26. Suppose your parents say you aren't doing well In your school work. Is 
this likely to happen more 

(a) because your work Isn't very good, or 

(b) because they are feeling cranky? 

27. Suppose you are showing a friend how to play a game and he has trouble 
with It. Would that happen 

(a) because he wasn't able to understand how to play, or 
(b) because you couldn't explain It well? 

28. When you find It easy to work arithmetic or math problems at school. Is 
It usually 

(a) because the teacher gave you especially easy problems, or 

(b) because you studied your book well before you tried them? 

29. When you remember something you heard in class. Is It usually 

(a) because you tried hard to remember, or 

(b) because the teacher explained it well? 

30. If you can't work a puzzle. Is It more likely to happen 

(a) because you are not especially good at working puzzles, or 

(b) because the Instructions weren't written clearly enough? 

31. If your parents tell you that you are bright or clever, is it more 
1 ikely 

(a) because they are feeling good, or 

(b) because of something you did? 

32. Suppose you are explaining how to play a game to a friend and he learns 
quickly. Would that happen more often 

(a) because you explained it well, or 

(b) because he was able to understand it? 

33. Suppose you're not sure about the answer to a question your teacher 
asks you and the answer you give turns out to be wrong. Is it likely 
to happen 

(a) because she was more particular than usual, or 

(b) because you answered too quickly? 

34. If a teacher says to you, "Try to do better," would it be 

(a) because this is something she might say to get pupils to try 
harder, or 

(b) because your work wasn't 3s good as usual? 
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DADE COUNTY PUBLIC SCHOOLS 
ELEMENTARY FORM (Grades 4 > 6) 
SCHOOL MORALE ATTITUDE SURVEY 



DIRECTIONS: 

This IS not a test This booklet lists a series of statements about your school. Read each statement carefully and decide 
whether your agree or disgree with the statement. If you agree, blacken the space under the letter "a" on your 
answer sheet for that statement, if you disagree, blacken the space under the letter d on your answer sheet for that 
statement. Please, answer every question. 

This IS part of a proiect being done in many different schools in the county No one at your school will see your answers. 
They will be scored elsewhere, so answer as honestly as you can. You will probably find that you generally agree with 
some of the statements and generally disagree with others. Do not answer as you think you should, but the way you 
really tee'. 
Thank you 



1 . Students can do wron^ thm^s and never get m trouble 


A 

0 


d 

(D 


13 


Someitmes we see films and fttmstrips at this schooi 


0 


a 

0 


2. Often I'm afraid that 1 M do something wrong at school 


® 


<3) 


14 


There are enough materials and supplies for most of my 
classes. 


0 


0 


3. 1 am very proud of my sc^oo) 


® 


Q> 


16 


School has not helped me learn about many new things. 


0 


0 


4 1 am luckv that 1 get to come to this school 


® 


(3) 


16. 


We do not have enough reading, wnitng and arithmetic 
each ddy 


0 


0 


5 If this schooi had more clubs. I d like »t bener 


0 


® 


1 7. 


1 can usually do my iiomework without any help 


0 


0 


d 1 would leli a new student that this is a gofv^ school 


0 


(3) 


1« 


My school books are m teffit>»e rondttiort 


0 


0 


7 f li rathef to this school than another otts 


0 


Q) 




m my ..Ihss 1 don i do ariythirty that ifuereii!» me 


0 


0 


8 No OHtt seems to understertd me at school 


0 


<3) 


•?o 


Wher> my <eaChor is not arouitd I Know how to siudv 


0 


© 


<J : think i am bs smait as the other studertis m niy g:dde 


0 


@ 
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1 d«»i«rv« ih« grades 1 yet un my p*ipe'4 9rni repott <:ard 


0 


0 


\Q Dim)s are not a major oroblem at our &rhoi>i 


0 


@ 


22 


Mo&t i\\ tfie ln)»e 1 feel 1 i»ruj»r>iafui ir\y s< hool work 


0 


0 


I 1 This school has u <> tuartv fuit)> 


0 


01) 


?3 


Iho p«f»{*'e a! th<s SI Puiol ntdkf tun ffei ltK« Ihey want 


© 


0 


1 2 Most of the studnfits htna ac en t v«f> «Mtdfo>tt'il m iifdni 
suorts 

NCS Trans Opuc fc r60t)7 64321 

1 1 


0 0 

MIS 320SS rOS 

1 1 


24 
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7h*«f*» i.Mi fiuii.h »»oi>« in the <.ldSsr.iorn for in« lo Icam (f) 

CONIINUfc ON RfcVtHSE 
1 r 1 


0 
1 
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OmECTIONS: 

USE A BUCK LEAD PENCIL ONLY (NO. 2 OR 2H) ERASE CLEANLY ANY ANSWER YOU WISH TO CHANGE. 

BLACKEN THE CIRCLE COMPLETELY. MAKE NO STRAY MARKS ON THE ANSWER SHEET. 



25. 


t have a place at school to keep my lunch and other 
things 


8 




37. 


t hAwMi nn tf AtiHI* witK tKtf» wkinrlt 1 httw# tn Hn in mw i^lAftft 


a 


d 




The furniture in this classroom is in pood condition 






38. 


Most days I'm happy to come to school 






27 


My classroom is r*ot comfortable m hot weather 






39 


1 usually get extra help with my lessons, if I want it. 






28. 


Everyone tries to keep our school clean. 






40. 


1 have to learn things 1 don't need to know. 


V-/ 




29 


My classrooms are not equipped with t>lackout curtams 
or anything else to make the rooms dark for movies 




€) 


41. 


There is no one in my school that 1 cotitd go to with a 
serious probtem<. 




® 


30 


My school IS not crowded 


® 


@ 


42 


Sometimes 1 feel that 1 }ust can't learn. 


® 




31 


In our library there is a place to work and study. 


® 




43 


1 am usually allowed to take my classroom books home. 


® 




J/ 


The bathrooms in thts school are clean. 


v5» 




A4. 


1 ask a lot of questions in class. 






33. 


Our phvsical education field is targe enough. 






45 


1 get angry with myself if 1 don't do as welt as 1 should 




(a) 


34 


Sometimes the cafeteria is used for special programs 


0 


® 


46, 


My classes are uninteresting end bormg. 


® 


® 


36 


t wish my school was pretty and clean like other 
schools 1 ve seen or he<«rd of 


® 




47. 


t tike to make the best grades possible 






36 


There are not many things in this school building that 
need to be fixed 


® 




48 


t can read a long white without genmg tired 


® 





STOP AT NUMBER 48 



DO NOT WRITE IN SHADED AREA 



er|c 



NAME 



Pl^tNT YOUR NAME IN THE BOXES FBOVIOEO TH€N 
BIACK€N THE lETTER BOX BELOW WHICH MATCHES 

f ACH irrrrR of your name 


iAST name 


FIRST NAME 


Ml 


Mill 1 


1 1 1 
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1 0 NUMBER 




SCHOOL 
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DADE COUNTY PUBLIC SCHOOLS 
PRIMARY FORM 
SCHOOL MORALE ATTITUDE SURVEY 



EXAMPLES; 



A. ICE CREAM TASTES BETTER THAN SALT, [v^ 



B. THE MIAMI DOLPHINS IS NOT THE BEST 
FOOTBALL TEAM. 



C. T V. IS MORE FUN THAN READING. 

LISTEN TO TEACHER'S INSTRUCTIONS 








YES 


NO 


1 


1 LIKfc SCHOOL 


f *r^* 1 




2 


SCHOOl MAKES ME WANT TO BE NICf. 






3 


THI- SCHOOL DAY IS TOO LONG 






4 


1 KHP MY SCHOOL Clf.AN AND MAT 




® 


f) 


MY SCMOOl IS OUll AM) U{ilY 


@ 




It 


M AN MAKI MY \( MOtU A i»IU «V! • I .*.( * 

* 







i 
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7 I OBEY TEACHER S RULES IN CLASS. 



YES NO 




14 f LIKE TO DO ARITHMETIC 



YES NO 




8 I STAY IN SCHOOL TOO LONG. 




15. I WANT TO LEARN MORE 




9. I LIKE TO STAY HOME BETTER THAN 1 
LIKE TO COME TO SCHOOL 




16 I LIKE TO WORK WITH NUMBERS 




CO 
00 



10 i WISH I WENT TO ANOTHER SCHOOL. 



11 I LIKE TO READ MY BOOKS 



12 LEARNING IS lASY fOR M€ 




17 OTHER KIDS THINK I AM A CLOWN 




IB SCHOOL WORK MAKES ME THINK 




19 GOOD READERS ARE GOOD SPHURS 






13 I 1HY HARD IN SCHOOt 




20 I lEARN f ROM MY MISTAKES 




MIS 23t?3 (08 /•) 
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